-- Logs begin at Wed 2022-08-24 07:01:30 UTC, end at Wed 2022-08-24 08:14:26 UTC. -- Aug 24 07:34:43.081195 dv-cinder-854275-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 07:34:43.091826 dv-cinder-854275-1-smb devstack@keystone.service[88239]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:34:43 2022] *** Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: nodename: dv-cinder-854275-1-smb Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: machine: x86_64 Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: clock source: unix Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: pcre jit disabled Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: detected number of CPU cores: 4 Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: current working directory: / Aug 24 07:34:43.093908 dv-cinder-854275-1-smb devstack@keystone.service[88239]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:34:43.094462 dv-cinder-854275-1-smb devstack@keystone.service[88239]: your processes number limit is 47680 Aug 24 07:34:43.094462 dv-cinder-854275-1-smb devstack@keystone.service[88239]: your memory page size is 4096 bytes Aug 24 07:34:43.094462 dv-cinder-854275-1-smb devstack@keystone.service[88239]: detected max file descriptor number: 2048 Aug 24 07:34:43.094462 dv-cinder-854275-1-smb devstack@keystone.service[88239]: lock engine: pthread robust mutexes Aug 24 07:34:43.094462 dv-cinder-854275-1-smb devstack@keystone.service[88239]: thunder lock: enabled Aug 24 07:34:43.094698 dv-cinder-854275-1-smb devstack@keystone.service[88239]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 07:34:43.094698 dv-cinder-854275-1-smb devstack@keystone.service[88239]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:34:43.134909 dv-cinder-854275-1-smb devstack@keystone.service[88239]: Python main interpreter initialized at 0x55b56a1d19c0 Aug 24 07:34:43.134909 dv-cinder-854275-1-smb devstack@keystone.service[88239]: python threads support enabled Aug 24 07:34:43.134909 dv-cinder-854275-1-smb devstack@keystone.service[88239]: your server socket listen backlog is limited to 100 connections Aug 24 07:34:43.134909 dv-cinder-854275-1-smb devstack@keystone.service[88239]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:34:43.135257 dv-cinder-854275-1-smb devstack@keystone.service[88239]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:34:43.135366 dv-cinder-854275-1-smb devstack@keystone.service[88239]: *** Operational MODE: preforking *** Aug 24 07:34:43.135615 dv-cinder-854275-1-smb devstack@keystone.service[88239]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:34:43.135615 dv-cinder-854275-1-smb devstack@keystone.service[88239]: spawned uWSGI master process (pid: 88239) Aug 24 07:34:43.135819 dv-cinder-854275-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 07:34:43.137970 dv-cinder-854275-1-smb devstack@keystone.service[88239]: spawned uWSGI worker 1 (pid: 88251, cores: 1) Aug 24 07:34:43.137970 dv-cinder-854275-1-smb devstack@keystone.service[88239]: spawned uWSGI worker 2 (pid: 88252, cores: 1) Aug 24 07:34:43.137970 dv-cinder-854275-1-smb devstack@keystone.service[88239]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:34:47.552432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:34:47.552432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: from cryptography.utils import int_from_bytes Aug 24 07:34:47.553210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:34:47.553210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: from cryptography.utils import int_from_bytes Aug 24 07:34:47.565845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:34:47.565845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: from cryptography.utils import int_from_bytes Aug 24 07:34:47.566324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:34:47.566324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: from cryptography.utils import int_from_bytes Aug 24 07:34:47.610396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:34:47.610547 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:34:47.610708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] command line args: [] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:34:47.610982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:34:47.611164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ================================================================================ {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:34:47.611452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] admin_token = **** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.611706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] config_dir = [] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.611898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.612085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] config_source = [] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.612267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] debug = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.612467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.613600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.613600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.613600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.613600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.613853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:34:47.613923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] list_limit = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.613982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:34:47.614038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] log_config_append = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.614103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] command line args: [] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:34:47.614164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.614272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] log_dir = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.614401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:34:47.614490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] log_file = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.614565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ================================================================================ {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:34:47.614680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.614769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] admin_token = **** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.614935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] config_dir = [] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] config_source = [] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615499 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] debug = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.615940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.616026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.616116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.616303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.616374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.616538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.616643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.616716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.616820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] list_limit = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.616947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.617050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] log_config_append = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.617167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.617267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.617354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] log_dir = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.617461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.617534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] log_file = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.617678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.617785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.617955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.618039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.618222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.618434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.618526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.618621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] publish_errors = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.618701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.618811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.618940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.619128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.619221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.619311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.619383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.619555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.619640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.619783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.619875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.620572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] standard_threads = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.620805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.620903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] use_journal = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] use_json = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] use_stderr = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] use_syslog = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.621997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.622154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.622417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.622493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.622661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] publish_errors = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.622746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.622899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.622975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.623134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.623216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.623328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.623414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.623576 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.623654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.623813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.623889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.624222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] standard_threads = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.624312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.624426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.624508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.624632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.624709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.624853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.624853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] use_journal = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.624987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.625057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] use_json = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.625148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.625225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] use_stderr = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.625350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] use_syslog = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.625425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.625571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:34:47.625648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.625831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.625915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.626070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.626147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.626327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.626403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.626566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.626643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.626815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.626894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.627054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.627132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.627326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.627407 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.627548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.627632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.627795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.627872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.628041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.628118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.628309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.628392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.628545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.628627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.628784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.628866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.629018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.629095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.629258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.629333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.629501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.629576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.629738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.629816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.629973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.630049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.630208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.630284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.630459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.630538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.630713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.630799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.630966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.631049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.631218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.631314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.631480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.631568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.631723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.631799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.631954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.632031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.632186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.632268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.632418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.632502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.632651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.632727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.632888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.632964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.633131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.633219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.633364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.633446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.633594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.633670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.633831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.633914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.634073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.634151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.634307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.634417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.634545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.634661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.634759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.634860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.635098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.635223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.635338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.635430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.635614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.636750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.636750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.636750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.644230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.649441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.649613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.649702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.649702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.649848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.649923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.649994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650274 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650435 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.650957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.651077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.651203 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.651417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.651656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.651738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.651809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.651890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.651963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652324 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.652992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.653070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.653141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.653219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.653300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.653419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.653507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.653586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.653683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.653805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.654941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.655948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656098 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.656922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657296 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657373 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] auth.external = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657593 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.657963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] auth.password = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] auth.token = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658540 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.658843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] credential.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] auth.external = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.659964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] auth.password = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] auth.token = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660540 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.660963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] credential.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.661956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] federation.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.662980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.663978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] federation.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664746 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.664947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.665931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666579 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.666721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.667340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.667442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.667542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.667616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.667709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.667835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.667931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.668993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.669943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.670968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.671951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.672999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.673984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674557 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.674982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.675052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.675130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.675202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.675273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.675429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.675501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.675501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678797 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.678939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679845 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.679915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] resource.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.680923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.681697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.682031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.682114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.682187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.682258 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] resource.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.682328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.682450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] role.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] role.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.683975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.684142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.684223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.684382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.684464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.684621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.684702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.684857 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] role.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.684936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.685102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] role.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.685183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.685332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.685412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.685579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.685676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.685849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.685930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.686097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.686176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.686343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.686431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.686591 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.686751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.686831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.686992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.687071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.687245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.687347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.687522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.687602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.687775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.687855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.688019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.688100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.688257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.688336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.688502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.688580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.688757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.688918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.688998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.689159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.689239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.689410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.689499 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.689686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.689767 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.689942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.690034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.690191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.690280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.690429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.690509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.690670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.690748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.690911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.690999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.691146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.691226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.691409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] token.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.691491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.691643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.691724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.691878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.691958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.692122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.692200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.692374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.692454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.692622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.692703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.692929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.693049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.693121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.693195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.693337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.693418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.693572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] token.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.693652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.693848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.693939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.694055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.694134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.694290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.694368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.694536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.694624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.694779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.694858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.695009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.695087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.695250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.695418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.695519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.695600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.695767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.695850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.connection = **** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.696005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.696097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.696245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.696326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.696481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.696560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.696726 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.696806 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.696975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.697055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.697202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.697280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.697440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.697518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.697680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.697761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.697930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.698024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.connection = **** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.698257 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.698383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.698506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.698747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.698827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.698993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.699072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.699230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.699330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.699486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.699564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.699719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.699799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.699954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.700034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.700201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.700283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.700437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.700517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.700618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:34:47.700696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.700904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.701151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.701385 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.701629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.701861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.702102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.702337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:34:47.702507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:34:47.735446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.735633 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.735722 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.735868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.735954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.736095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.744489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.744592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.777578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.777712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.777808 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.777893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.840202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.840492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.897290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.897449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.905356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:47.905598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.070144 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.070359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.070433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.070588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.070675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.070811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.070904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.071033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.071114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.071248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.071360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.071512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.095400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.095551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.095635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.095747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.095847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.095975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.096058 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.096200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.096282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.096423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.096514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.096643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.096726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.096862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.109284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.110484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.123703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.123839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.123926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.124061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.124144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.124288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.124371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.124516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.124597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.124738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.124829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.124958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.125041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88251) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.125178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:34:48.147742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.147865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.147945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:34:48.148019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:34:48.148243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.148327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.148449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:34:48.148542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:34:48.148732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.148819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.149002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.149083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.149519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.149601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.149787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.149867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.159726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.159823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.160013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.160096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.160289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.160371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.160583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.160675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.168280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.168400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.171172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.171335 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.171601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.171697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.171809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.171953 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.172100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.172244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.172393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.172537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.172662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.172806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.172940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.173083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.173207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.173388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.173595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.173780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.173868 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.174066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.174146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.174343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.197452 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.197852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.199799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.200097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.200972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.201321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.204906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.205194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.205483 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.206095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.206388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.206681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.212168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.213236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.213529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.216936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.217235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.217527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.217820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.218127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.218415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.218685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.218778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.218960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.219065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.219389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.219685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.219971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.220252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.220530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.220806 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.236498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.236784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.238254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.238542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.240694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.242572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.244009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.244317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.245956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.246254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.248611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.250587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.254344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.254433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.255057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.255393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.255694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.255996 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.256290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.256585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.257087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.257398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.257694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.257987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.258282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.258622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.272997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.273293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.273571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.273842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.275059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.275410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.275690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.275964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.281534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.283075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.283382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.283816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.285348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.285633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.286028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.286323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.286623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.286920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.287217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.288640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.288967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.289268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.292312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.292312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.298898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.299195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.299506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.299795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.300085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.300371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.300656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.301541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.301830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.302120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.302410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.302700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.303076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.303399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.316672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.319445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.319708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.322517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.322679 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.324677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.326160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.326242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.326455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.326785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.327745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.329230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.329518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.329821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.333316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.334809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.336403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.337749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.337856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.338057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.338556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.339275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.341599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.341895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.342195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.342486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.347270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.350023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.350023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.350559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.350857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.351148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.354913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88251) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.355227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.355549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.355831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.356127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.356497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.356781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.357059 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.357347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.357623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.358323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.358323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.358577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:34:48.358709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.358877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.359007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88251) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.359136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.359136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.359406 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.359622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.359902 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.360177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.360461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.360752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.361034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.361306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.361637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.361903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:34:48.393814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b56a1d19c0 pid: 88251 (default app) Aug 24 07:34:48.397297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5748bcc-8f79-45b4-90fb-20bc8e8b7e6d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:34:48.397589 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b56a1d19c0 pid: 88252 (default app) Aug 24 07:34:48.397683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5748bcc-8f79-45b4-90fb-20bc8e8b7e6d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:34:48.397907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5748bcc-8f79-45b4-90fb-20bc8e8b7e6d None None] PATH_INFO: `/v3` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:34:48.402299 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Wed Aug 24 07:34:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:34:55.878266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb8420-16ed-4759-ac25-277b325b33e7 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:34:55.878802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb8420-16ed-4759-ac25-277b325b33e7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:34:55.878889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb8420-16ed-4759-ac25-277b325b33e7 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:34:55.883126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:34:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:34:55.890372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:34:55.890775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:34:55.890917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:34:55.961423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: INFO dbcounter [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] Registered counter for database keystone Aug 24 07:34:55.982076 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG oslo_db.sqlalchemy.engines [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:34:55.988450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writer thread running {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:34:56.172172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG passlib.handlers.bcrypt [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88251) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 07:34:56.172521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG passlib.handlers.bcrypt [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88251) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 07:34:56.228903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:34:56.230705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:34:56.361462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:34:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 07:34:56.825554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb8420-16ed-4759-ac25-277b325b33e7 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:34:56.893452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: INFO dbcounter [None req-2fbb8420-16ed-4759-ac25-277b325b33e7 None None] Registered counter for database keystone Aug 24 07:34:56.915139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG oslo_db.sqlalchemy.engines [None req-2fbb8420-16ed-4759-ac25-277b325b33e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:34:56.922084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writer thread running {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:34:57.039400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb8420-16ed-4759-ac25-277b325b33e7 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:34:57.044513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284f88f-eca9-42a1-adc6-f08d9f294883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:34:57.045137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284f88f-eca9-42a1-adc6-f08d9f294883 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:34:57.045425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284f88f-eca9-42a1-adc6-f08d9f294883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:34:57.045707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284f88f-eca9-42a1-adc6-f08d9f294883 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:34:57.053988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284f88f-eca9-42a1-adc6-f08d9f294883 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:34:57.106313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0284f88f-eca9-42a1-adc6-f08d9f294883 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 07:34:57.106590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284f88f-eca9-42a1-adc6-f08d9f294883 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:34:57.116107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Aug 24 07:34:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:34:57.122848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:34:57.137809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaae60-dec4-41e4-884c-c201d538ed06 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:34:57.142244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edc07c-6cb0-44c8-af02-9868c569fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:34:57.143357 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edc07c-6cb0-44c8-af02-9868c569fb3b admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:34:57.143647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edc07c-6cb0-44c8-af02-9868c569fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:34:57.143926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edc07c-6cb0-44c8-af02-9868c569fb3b admin admin] PATH_INFO: `/v3/projects/0aa975bb77094d52bcdbb2bd261327d8` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:34:57.145508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edc07c-6cb0-44c8-af02-9868c569fb3b admin admin] RBAC: Authorizing `identity:get_project(project_id=0aa975bb77094d52bcdbb2bd261327d8)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:34:57.199794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6edc07c-6cb0-44c8-af02-9868c569fb3b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 07:34:57.200141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edc07c-6cb0-44c8-af02-9868c569fb3b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:34:57.204654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Wed Aug 24 07:34:57 2022] GET /identity/v3/projects/0aa975bb77094d52bcdbb2bd261327d8 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:34:59.122632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e6c62-e563-4084-b7af-d3555a291210 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:34:59.123170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e6c62-e563-4084-b7af-d3555a291210 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:34:59.123170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e6c62-e563-4084-b7af-d3555a291210 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:34:59.127302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:34:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:34:59.132803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258142b-7253-4045-927f-74dc91181f49 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:34:59.133198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258142b-7253-4045-927f-74dc91181f49 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:34:59.133358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258142b-7253-4045-927f-74dc91181f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:34:59.153346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a258142b-7253-4045-927f-74dc91181f49 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:34:59.154863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a258142b-7253-4045-927f-74dc91181f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:34:59.162535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:34:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 07:34:59.425752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e6c62-e563-4084-b7af-d3555a291210 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:34:59.438620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e6c62-e563-4084-b7af-d3555a291210 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:34:59.442843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1fb2a-261e-48f9-a268-bf12209a1ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:34:59.443474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1fb2a-261e-48f9-a268-bf12209a1ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:34:59.443757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1fb2a-261e-48f9-a268-bf12209a1ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:34:59.444030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1fb2a-261e-48f9-a268-bf12209a1ce9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:34:59.451703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1fb2a-261e-48f9-a268-bf12209a1ce9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:34:59.453489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1fb2a-261e-48f9-a268-bf12209a1ce9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:34:59.462149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Aug 24 07:34:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 07:34:59.467436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258142b-7253-4045-927f-74dc91181f49 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:34:59.476325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258142b-7253-4045-927f-74dc91181f49 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:34:59.481134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dadc76-595d-406c-818e-609ebed7bb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:34:59.481791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dadc76-595d-406c-818e-609ebed7bb25 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:34:59.482071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dadc76-595d-406c-818e-609ebed7bb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:34:59.482346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dadc76-595d-406c-818e-609ebed7bb25 admin admin] PATH_INFO: `/v3/users/46428667f2c84b109fb9821da86b0938` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:34:59.483679 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dadc76-595d-406c-818e-609ebed7bb25 admin admin] RBAC: Authorizing `identity:get_user(user_id=46428667f2c84b109fb9821da86b0938)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:34:59.485516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dadc76-595d-406c-818e-609ebed7bb25 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:34:59.487022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Wed Aug 24 07:34:59 2022] GET /identity/v3/users/46428667f2c84b109fb9821da86b0938 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:01.485392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d132c3-1b49-4770-9003-020bee8e12af None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:01.485889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d132c3-1b49-4770-9003-020bee8e12af None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:01.485984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d132c3-1b49-4770-9003-020bee8e12af None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:01.487263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:01.492650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1c92-dab4-4de1-82c4-af3b5b330080 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:01.493014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1c92-dab4-4de1-82c4-af3b5b330080 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:01.493322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1c92-dab4-4de1-82c4-af3b5b330080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:01.510945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-56eb1c92-dab4-4de1-82c4-af3b5b330080 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:01.511587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211759-f94e-4849-be07-0f4202ce4eb3 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:01.511874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211759-f94e-4849-be07-0f4202ce4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:01.512135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-56eb1c92-dab4-4de1-82c4-af3b5b330080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:01.512220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211759-f94e-4849-be07-0f4202ce4eb3 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:01.513427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:01.518439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43968b8d-ee27-42ac-bcac-451513ab28cd None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:01.518770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43968b8d-ee27-42ac-bcac-451513ab28cd None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:01.519059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43968b8d-ee27-42ac-bcac-451513ab28cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:01.563765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG passlib.handlers.bcrypt [None req-43968b8d-ee27-42ac-bcac-451513ab28cd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88252) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 07:35:01.564183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG passlib.handlers.bcrypt [None req-43968b8d-ee27-42ac-bcac-451513ab28cd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88252) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 07:35:01.593069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:01.610112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-43968b8d-ee27-42ac-bcac-451513ab28cd None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:01.611664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-43968b8d-ee27-42ac-bcac-451513ab28cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:01.718293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:01.869133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1c92-dab4-4de1-82c4-af3b5b330080 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:01.893077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:01.974537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1c92-dab4-4de1-82c4-af3b5b330080 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:01.996966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43968b8d-ee27-42ac-bcac-451513ab28cd None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:02.010131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b2714-50ae-46e8-8eed-0344dc64c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:02.010769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b2714-50ae-46e8-8eed-0344dc64c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:02.011048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b2714-50ae-46e8-8eed-0344dc64c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:02.011349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b2714-50ae-46e8-8eed-0344dc64c7b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:02.022885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b2714-50ae-46e8-8eed-0344dc64c7b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-f75b2714-50ae-46e8-8eed-0344dc64c7b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:02.032019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:02.032999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:02.033835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:02.040492 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b2714-50ae-46e8-8eed-0344dc64c7b8 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:02.099034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43968b8d-ee27-42ac-bcac-451513ab28cd None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:02.101540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:02.126103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:02.138409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe4292-7c88-4941-9bb4-34dcb70f90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:02.139272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe4292-7c88-4941-9bb4-34dcb70f90a0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:02.139586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe4292-7c88-4941-9bb4-34dcb70f90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:02.139856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe4292-7c88-4941-9bb4-34dcb70f90a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:02.142095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b2714-50ae-46e8-8eed-0344dc64c7b8 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:02.175220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f928f9-00f1-4e59-abf8-6a12e13d4574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:02.175853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f928f9-00f1-4e59-abf8-6a12e13d4574 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:02.176129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f928f9-00f1-4e59-abf8-6a12e13d4574 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:02.176399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f928f9-00f1-4e59-abf8-6a12e13d4574 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:02.177060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f928f9-00f1-4e59-abf8-6a12e13d4574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:02.177358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f928f9-00f1-4e59-abf8-6a12e13d4574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:02.179615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f928f9-00f1-4e59-abf8-6a12e13d4574 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:02.192028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:02.198593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f928f9-00f1-4e59-abf8-6a12e13d4574 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:02.211421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe4292-7c88-4941-9bb4-34dcb70f90a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:02.212950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe4292-7c88-4941-9bb4-34dcb70f90a0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:02.301954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f928f9-00f1-4e59-abf8-6a12e13d4574 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:02.311495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:35:02.317021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe4292-7c88-4941-9bb4-34dcb70f90a0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:02.320602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:02.336331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea2ccd-ac6b-4116-80fe-4e5dc1203486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:02.336975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea2ccd-ac6b-4116-80fe-4e5dc1203486 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:02.337281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea2ccd-ac6b-4116-80fe-4e5dc1203486 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:02.338058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea2ccd-ac6b-4116-80fe-4e5dc1203486 None admin] PATH_INFO: `/v3/users/46428667f2c84b109fb9821da86b0938` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:02.340010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea2ccd-ac6b-4116-80fe-4e5dc1203486 None admin] RBAC: Authorizing `identity:get_user(user_id=46428667f2c84b109fb9821da86b0938)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:02.341497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea2ccd-ac6b-4116-80fe-4e5dc1203486 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:02.343153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:02 2022] GET /identity/v3/users/46428667f2c84b109fb9821da86b0938 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:02.348684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea2ccd-ac6b-4116-80fe-4e5dc1203486 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:02.364364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:02.417592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe4292-7c88-4941-9bb4-34dcb70f90a0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:02.449075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea2ccd-ac6b-4116-80fe-4e5dc1203486 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:02.451739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639ac25-170b-4fa2-bd64-d490bf5d7571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:02.452575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639ac25-170b-4fa2-bd64-d490bf5d7571 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:02.452846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639ac25-170b-4fa2-bd64-d490bf5d7571 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:02.453110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639ac25-170b-4fa2-bd64-d490bf5d7571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:02.471233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639ac25-170b-4fa2-bd64-d490bf5d7571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:02.472726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639ac25-170b-4fa2-bd64-d490bf5d7571 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:02.482391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882114c-8e2f-43bb-bbdc-cb2cd8540ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:02.483019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882114c-8e2f-43bb-bbdc-cb2cd8540ced None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:02.483372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882114c-8e2f-43bb-bbdc-cb2cd8540ced None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:02.483617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882114c-8e2f-43bb-bbdc-cb2cd8540ced None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:02.484723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882114c-8e2f-43bb-bbdc-cb2cd8540ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:02.486162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882114c-8e2f-43bb-bbdc-cb2cd8540ced None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:02.488153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-8639ac25-170b-4fa2-bd64-d490bf5d7571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:35:02.491092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:02.492364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:35:02.493190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:35:02.493190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:35:02.493190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:02.493190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:02.495650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882114c-8e2f-43bb-bbdc-cb2cd8540ced None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:02.498377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639ac25-170b-4fa2-bd64-d490bf5d7571 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:02.554809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:02.577605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:02.596297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882114c-8e2f-43bb-bbdc-cb2cd8540ced None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:02.598750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639ac25-170b-4fa2-bd64-d490bf5d7571 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:02.632217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740c35-68c5-4f58-ba3f-f90ee90aa7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:02.632483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295384e1-1d02-4276-8c08-f13ade340879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:02.632832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740c35-68c5-4f58-ba3f-f90ee90aa7c9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:02.633078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295384e1-1d02-4276-8c08-f13ade340879 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:02.633165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740c35-68c5-4f58-ba3f-f90ee90aa7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:02.633355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295384e1-1d02-4276-8c08-f13ade340879 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:02.633444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740c35-68c5-4f58-ba3f-f90ee90aa7c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:02.633625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295384e1-1d02-4276-8c08-f13ade340879 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:02.634075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740c35-68c5-4f58-ba3f-f90ee90aa7c9 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.domain.id=default, user.id=46428667f2c84b109fb9821da86b0938) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:02.634794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295384e1-1d02-4276-8c08-f13ade340879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:02.635259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295384e1-1d02-4276-8c08-f13ade340879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:02.635544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740c35-68c5-4f58-ba3f-f90ee90aa7c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:02.636669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295384e1-1d02-4276-8c08-f13ade340879 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:02.636984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740c35-68c5-4f58-ba3f-f90ee90aa7c9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:02.643542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Aug 24 07:35:02 2022] GET /identity/v3/role_assignments?user.id=46428667f2c84b109fb9821da86b0938&scope.domain.id=default&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:02.655615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:04.671927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4101c-f783-4e48-b997-c6698ae65ef1 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:04.672413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4101c-f783-4e48-b997-c6698ae65ef1 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:04.672413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4101c-f783-4e48-b997-c6698ae65ef1 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:04.673721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:04.679313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c20d1-eceb-405e-9e99-d59599be3f13 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:04.680149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c20d1-eceb-405e-9e99-d59599be3f13 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:04.680623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c20d1-eceb-405e-9e99-d59599be3f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:04.704039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-657c20d1-eceb-405e-9e99-d59599be3f13 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:04.705540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-657c20d1-eceb-405e-9e99-d59599be3f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:04.800179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:05.048840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c72525-9aee-44b0-9d00-5fa746123268 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:05.049547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c72525-9aee-44b0-9d00-5fa746123268 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:05.050021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c72525-9aee-44b0-9d00-5fa746123268 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:05.051583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:05.057958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0077fb-d567-406c-b044-a7e37d4a5b4c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:05.058577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0077fb-d567-406c-b044-a7e37d4a5b4c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:05.059062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0077fb-d567-406c-b044-a7e37d4a5b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:05.083702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-4c0077fb-d567-406c-b044-a7e37d4a5b4c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:05.085226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4c0077fb-d567-406c-b044-a7e37d4a5b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:05.143652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:05.175887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 12/25] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:05.223528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c72525-9aee-44b0-9d00-5fa746123268 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:05.315157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee53721-d33f-4b30-8a7d-3e514197aaf7 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:05.315786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee53721-d33f-4b30-8a7d-3e514197aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:05.316290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee53721-d33f-4b30-8a7d-3e514197aaf7 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:05.317830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 13/26] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:05.323710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a600f5-9343-486f-b6ce-89fbacfe35cf None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:05.324235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a600f5-9343-486f-b6ce-89fbacfe35cf None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:05.324695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a600f5-9343-486f-b6ce-89fbacfe35cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:05.364594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e9a600f5-9343-486f-b6ce-89fbacfe35cf None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:05.367006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e9a600f5-9343-486f-b6ce-89fbacfe35cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:05.389011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c72525-9aee-44b0-9d00-5fa746123268 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:05.456928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d588a-f33c-40d0-a118-4dfd01362dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:05.457574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d588a-f33c-40d0-a118-4dfd01362dfd None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:05.458430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d588a-f33c-40d0-a118-4dfd01362dfd None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:05.458847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d588a-f33c-40d0-a118-4dfd01362dfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:05.488185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d588a-f33c-40d0-a118-4dfd01362dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-456d588a-f33c-40d0-a118-4dfd01362dfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:05.496221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:05.497176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:05.497917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:05.500386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 14/27] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:05.506392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d588a-f33c-40d0-a118-4dfd01362dfd None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:05.511338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:05.514671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 14/28] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:05.595306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a600f5-9343-486f-b6ce-89fbacfe35cf None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:05.673029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d588a-f33c-40d0-a118-4dfd01362dfd None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:05.739142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bc245-6da6-4da1-8efb-447ff3a16192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:05.739781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bc245-6da6-4da1-8efb-447ff3a16192 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:05.740057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bc245-6da6-4da1-8efb-447ff3a16192 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:05.740326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bc245-6da6-4da1-8efb-447ff3a16192 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:05.740992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bc245-6da6-4da1-8efb-447ff3a16192 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:05.741290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bc245-6da6-4da1-8efb-447ff3a16192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:05.742684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bc245-6da6-4da1-8efb-447ff3a16192 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:05.765352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 15/29] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:05.766736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae5e4-b99c-4d03-82fb-ddb81932a746 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:05.767034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae5e4-b99c-4d03-82fb-ddb81932a746 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:05.767331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae5e4-b99c-4d03-82fb-ddb81932a746 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:05.767443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a600f5-9343-486f-b6ce-89fbacfe35cf None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:05.768635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:05.774169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6dcc5-f012-46ef-9511-0db5ac787187 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:05.774462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6dcc5-f012-46ef-9511-0db5ac787187 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:05.774807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6dcc5-f012-46ef-9511-0db5ac787187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:05.775866 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:05.811466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3be6dcc5-f012-46ef-9511-0db5ac787187 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:05.812646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3be6dcc5-f012-46ef-9511-0db5ac787187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:05.848053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8dd59-bab5-41cc-ae38-e9c4473a93de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:05.848966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8dd59-bab5-41cc-ae38-e9c4473a93de None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:05.849450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8dd59-bab5-41cc-ae38-e9c4473a93de None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:05.849916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8dd59-bab5-41cc-ae38-e9c4473a93de None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:05.850850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8dd59-bab5-41cc-ae38-e9c4473a93de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:05.852520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8dd59-bab5-41cc-ae38-e9c4473a93de None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:05.880900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:05.889179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 17/31] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:05.890068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6dcc5-f012-46ef-9511-0db5ac787187 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:06.007698 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6dcc5-f012-46ef-9511-0db5ac787187 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:06.063821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc632c-61ef-44ba-8500-faa2a7a238cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:06.064471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc632c-61ef-44ba-8500-faa2a7a238cd None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.064806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc632c-61ef-44ba-8500-faa2a7a238cd None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.065098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc632c-61ef-44ba-8500-faa2a7a238cd None admin] PATH_INFO: `/v3/users/46428667f2c84b109fb9821da86b0938` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.067440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc632c-61ef-44ba-8500-faa2a7a238cd None admin] RBAC: Authorizing `identity:get_user(user_id=46428667f2c84b109fb9821da86b0938)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:06.069003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc632c-61ef-44ba-8500-faa2a7a238cd None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:06.070664 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 18/32] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:05 2022] GET /identity/v3/users/46428667f2c84b109fb9821da86b0938 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:06.072653 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc632c-61ef-44ba-8500-faa2a7a238cd None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:06.122517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 15/33] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 07:35:05 2022] POST /identity/v3/roles => generated 219 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:35:06.130997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8dd59-bab5-41cc-ae38-e9c4473a93de None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:06.214770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:06.282495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc632c-61ef-44ba-8500-faa2a7a238cd None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:06.350891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8dd59-bab5-41cc-ae38-e9c4473a93de None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:06.378343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c8208-24f7-495e-a7c3-5d6f12aeb69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:06.378920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c8208-24f7-495e-a7c3-5d6f12aeb69a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.379197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c8208-24f7-495e-a7c3-5d6f12aeb69a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.379489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c8208-24f7-495e-a7c3-5d6f12aeb69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.396491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c8208-24f7-495e-a7c3-5d6f12aeb69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:06.398628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c8208-24f7-495e-a7c3-5d6f12aeb69a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:06.415939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c588485-d32d-4232-b037-fd2e06ea091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:06.416645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c588485-d32d-4232-b037-fd2e06ea091b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.416872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c588485-d32d-4232-b037-fd2e06ea091b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.417130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c588485-d32d-4232-b037-fd2e06ea091b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.418592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c588485-d32d-4232-b037-fd2e06ea091b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:06.420200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c588485-d32d-4232-b037-fd2e06ea091b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:06.421781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 16/34] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-364c8208-24f7-495e-a7c3-5d6f12aeb69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:35:06.422505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:06.423647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:35:06.424423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:35:06.424423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:35:06.424423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:06.424570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c588485-d32d-4232-b037-fd2e06ea091b None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:06.427852 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 19/35] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:06.429006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c8208-24f7-495e-a7c3-5d6f12aeb69a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:06.472925 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:06.577506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c8208-24f7-495e-a7c3-5d6f12aeb69a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:06.582116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c588485-d32d-4232-b037-fd2e06ea091b None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:06.597730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:06.616155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a525322-a86d-4cd6-b684-f03f56ae6a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:06.616810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a525322-a86d-4cd6-b684-f03f56ae6a6b None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.617091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a525322-a86d-4cd6-b684-f03f56ae6a6b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.617366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a525322-a86d-4cd6-b684-f03f56ae6a6b None admin] PATH_INFO: `/v3/domains/default/users/46428667f2c84b109fb9821da86b0938/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.618397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493361e5-8d56-465b-b62f-d2e859ba07cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:06.619186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493361e5-8d56-465b-b62f-d2e859ba07cd None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.619371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a525322-a86d-4cd6-b684-f03f56ae6a6b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=46428667f2c84b109fb9821da86b0938, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:06.619537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493361e5-8d56-465b-b62f-d2e859ba07cd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.619937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493361e5-8d56-465b-b62f-d2e859ba07cd None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.620645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493361e5-8d56-465b-b62f-d2e859ba07cd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:06.620826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a525322-a86d-4cd6-b684-f03f56ae6a6b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:06.622046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493361e5-8d56-465b-b62f-d2e859ba07cd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:06.732380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 17/36] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 07:35:06 2022] POST /identity/v3/roles => generated 225 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:06.733321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493361e5-8d56-465b-b62f-d2e859ba07cd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:06.823470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 20/37] 10.222.0.17 () {58 vars in 1361 bytes} [Wed Aug 24 07:35:06 2022] PUT /identity/v3/domains/default/users/46428667f2c84b109fb9821da86b0938/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:06.823470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d062d-2bf1-4d33-8b15-b4942b85a18a None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.823470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d062d-2bf1-4d33-8b15-b4942b85a18a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.823470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d062d-2bf1-4d33-8b15-b4942b85a18a None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.823470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 21/38] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:06.824515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b8ee3-8d26-4727-8591-932506986811 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.824515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b8ee3-8d26-4727-8591-932506986811 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.824515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b8ee3-8d26-4727-8591-932506986811 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.826644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 22/39] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:06.828454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb4c9-7a38-4b59-bcba-420e0b6648cc None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.828752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb4c9-7a38-4b59-bcba-420e0b6648cc None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.829034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb4c9-7a38-4b59-bcba-420e0b6648cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.856060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:06.856590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-433cb4c9-7a38-4b59-bcba-420e0b6648cc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:06.858186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-433cb4c9-7a38-4b59-bcba-420e0b6648cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:06.865693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493361e5-8d56-465b-b62f-d2e859ba07cd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:06.926353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843fc40-edc9-44ad-ba7e-f978f9a29d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:06.926986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843fc40-edc9-44ad-ba7e-f978f9a29d50 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.927625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843fc40-edc9-44ad-ba7e-f978f9a29d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.927625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843fc40-edc9-44ad-ba7e-f978f9a29d50 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.928269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843fc40-edc9-44ad-ba7e-f978f9a29d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:06.928577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843fc40-edc9-44ad-ba7e-f978f9a29d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:06.929998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843fc40-edc9-44ad-ba7e-f978f9a29d50 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:06.945063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 23/40] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:06.946340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2a38-aa31-4acd-a05a-87aff515430e None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:06.947988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2a38-aa31-4acd-a05a-87aff515430e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:06.947988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2a38-aa31-4acd-a05a-87aff515430e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:06.949705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 18/41] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:06.956937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843fc40-edc9-44ad-ba7e-f978f9a29d50 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:06.970219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-79ef2a38-aa31-4acd-a05a-87aff515430e None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:06.971573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-79ef2a38-aa31-4acd-a05a-87aff515430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:07.061677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 24/42] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:07.089743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843fc40-edc9-44ad-ba7e-f978f9a29d50 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:07.126627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261e0b9-0cd6-4166-bc24-e791417dd0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:07.127271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261e0b9-0cd6-4166-bc24-e791417dd0b7 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:07.127549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261e0b9-0cd6-4166-bc24-e791417dd0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:07.127821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261e0b9-0cd6-4166-bc24-e791417dd0b7 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:07.128470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261e0b9-0cd6-4166-bc24-e791417dd0b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:07.129988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261e0b9-0cd6-4166-bc24-e791417dd0b7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:07.225535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 19/43] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:35:06 2022] POST /identity/v3/projects => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:35:07.256677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2a38-aa31-4acd-a05a-87aff515430e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:07.297779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:07.340212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261e0b9-0cd6-4166-bc24-e791417dd0b7 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:07.360320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:07.379770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2a38-aa31-4acd-a05a-87aff515430e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:07.427884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10a1c5-1b2a-4daf-88f2-4000ed18f220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:07.428792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a1c5-1b2a-4daf-88f2-4000ed18f220 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:07.429078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a1c5-1b2a-4daf-88f2-4000ed18f220 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:07.429381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a1c5-1b2a-4daf-88f2-4000ed18f220 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:07.431851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10a1c5-1b2a-4daf-88f2-4000ed18f220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:07.434525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10a1c5-1b2a-4daf-88f2-4000ed18f220 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:07.436475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 25/44] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:07.444247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10a1c5-1b2a-4daf-88f2-4000ed18f220 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:07.489958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261e0b9-0cd6-4166-bc24-e791417dd0b7 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:07.528386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b3495-6668-4964-9e6b-d6ffd9526277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:07.529019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3495-6668-4964-9e6b-d6ffd9526277 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:07.529300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3495-6668-4964-9e6b-d6ffd9526277 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:07.529573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3495-6668-4964-9e6b-d6ffd9526277 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:07.530248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3495-6668-4964-9e6b-d6ffd9526277 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:07.531723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3495-6668-4964-9e6b-d6ffd9526277 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:07.592547 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 20/45] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 07:35:07 2022] POST /identity/v3/roles => generated 223 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:07.668182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10a1c5-1b2a-4daf-88f2-4000ed18f220 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:07.670966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:07.707840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d78ee-7d60-4fa5-bed8-4414d4e81330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:07.708474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d78ee-7d60-4fa5-bed8-4414d4e81330 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:07.708760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d78ee-7d60-4fa5-bed8-4414d4e81330 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:07.709039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d78ee-7d60-4fa5-bed8-4414d4e81330 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:07.709700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d78ee-7d60-4fa5-bed8-4414d4e81330 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:07.711189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d78ee-7d60-4fa5-bed8-4414d4e81330 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:07.820514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 26/46] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:35:07 2022] POST /identity/v3/projects => generated 312 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:08.811742 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c7ba8-7c33-4cd7-aa7a-cf15ca1f36b0 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:08.812245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c7ba8-7c33-4cd7-aa7a-cf15ca1f36b0 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:08.812350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c7ba8-7c33-4cd7-aa7a-cf15ca1f36b0 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:08.813671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 21/47] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:08.818982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3175-e75f-42f5-8c16-16a9d022f5f5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:08.819375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3175-e75f-42f5-8c16-16a9d022f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:08.819586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3175-e75f-42f5-8c16-16a9d022f5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:08.838236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a76c3175-e75f-42f5-8c16-16a9d022f5f5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:08.839470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a76c3175-e75f-42f5-8c16-16a9d022f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:08.911490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 27/48] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:09.183261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c7ba8-7c33-4cd7-aa7a-cf15ca1f36b0 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:09.252830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:09.295641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c7ba8-7c33-4cd7-aa7a-cf15ca1f36b0 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:09.333462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9c566-874c-46dd-8f79-d3bae26ab8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:09.334331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9c566-874c-46dd-8f79-d3bae26ab8c5 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:09.334835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9c566-874c-46dd-8f79-d3bae26ab8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:09.335232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9c566-874c-46dd-8f79-d3bae26ab8c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:09.457609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9c566-874c-46dd-8f79-d3bae26ab8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-12c9c566-874c-46dd-8f79-d3bae26ab8c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:09.464148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:09.465167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:09.465945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 22/49] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:09.471485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3175-e75f-42f5-8c16-16a9d022f5f5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:09.561563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:09.576503 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3175-e75f-42f5-8c16-16a9d022f5f5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:09.610475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6ad61-ef78-49fb-b0ce-8585127f3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:09.611170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6ad61-ef78-49fb-b0ce-8585127f3b40 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:09.611492 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6ad61-ef78-49fb-b0ce-8585127f3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:09.611777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6ad61-ef78-49fb-b0ce-8585127f3b40 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:09.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6ad61-ef78-49fb-b0ce-8585127f3b40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:09.612768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6ad61-ef78-49fb-b0ce-8585127f3b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:09.614241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6ad61-ef78-49fb-b0ce-8585127f3b40 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:09.622931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 28/50] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:09.628555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9c566-874c-46dd-8f79-d3bae26ab8c5 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:09.726730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c353-4cf9-466b-9031-a72e0d306192 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:09.726948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c353-4cf9-466b-9031-a72e0d306192 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:09.727259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c353-4cf9-466b-9031-a72e0d306192 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:09.728716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 29/51] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:09.731517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9c566-874c-46dd-8f79-d3bae26ab8c5 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:09.733745 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9941-d2ad-4880-b067-6cd0dc7b4e25 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:09.734039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9941-d2ad-4880-b067-6cd0dc7b4e25 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:09.734323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9941-d2ad-4880-b067-6cd0dc7b4e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:09.752638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-eb0c9941-d2ad-4880-b067-6cd0dc7b4e25 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:09.753835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-eb0c9941-d2ad-4880-b067-6cd0dc7b4e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:09.757560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:09.766490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb697bc-11a4-4c50-951b-895579035d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:09.767124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb697bc-11a4-4c50-951b-895579035d8d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:09.767439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb697bc-11a4-4c50-951b-895579035d8d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:09.767717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb697bc-11a4-4c50-951b-895579035d8d None admin] PATH_INFO: `/v3/users/46428667f2c84b109fb9821da86b0938` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:09.769084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb697bc-11a4-4c50-951b-895579035d8d None admin] RBAC: Authorizing `identity:get_user(user_id=46428667f2c84b109fb9821da86b0938)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:09.770530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb697bc-11a4-4c50-951b-895579035d8d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:09.772188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 23/52] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:09 2022] GET /identity/v3/users/46428667f2c84b109fb9821da86b0938 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:09.777849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb697bc-11a4-4c50-951b-895579035d8d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:09.821924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 30/53] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:09.877389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb697bc-11a4-4c50-951b-895579035d8d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:09.910773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda2eb2-3af6-4731-8f6a-7fe321529674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:09.911434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda2eb2-3af6-4731-8f6a-7fe321529674 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:09.911719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda2eb2-3af6-4731-8f6a-7fe321529674 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:09.911993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda2eb2-3af6-4731-8f6a-7fe321529674 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:09.913106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda2eb2-3af6-4731-8f6a-7fe321529674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:09.914558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda2eb2-3af6-4731-8f6a-7fe321529674 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:09.916767 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 24/54] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:09.922717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c9941-d2ad-4880-b067-6cd0dc7b4e25 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:10.003022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:10.023932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c9941-d2ad-4880-b067-6cd0dc7b4e25 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:10.058138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415bcff-d551-428d-bed9-d894f8eefbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:10.058747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bcff-d551-428d-bed9-d894f8eefbdb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:10.059032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bcff-d551-428d-bed9-d894f8eefbdb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:10.059329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bcff-d551-428d-bed9-d894f8eefbdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:10.060063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415bcff-d551-428d-bed9-d894f8eefbdb None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.domain.id=default, user.id=46428667f2c84b109fb9821da86b0938) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:10.060373 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415bcff-d551-428d-bed9-d894f8eefbdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:10.061829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415bcff-d551-428d-bed9-d894f8eefbdb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:10.067619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 31/55] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Aug 24 07:35:09 2022] GET /identity/v3/role_assignments?user.id=46428667f2c84b109fb9821da86b0938&scope.domain.id=default&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:10.100357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda2eb2-3af6-4731-8f6a-7fe321529674 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:10.167006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:10.209559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda2eb2-3af6-4731-8f6a-7fe321529674 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:10.246182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd37ced-3396-46d5-a780-0539d11e5b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:10.246824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd37ced-3396-46d5-a780-0539d11e5b97 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:10.247106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd37ced-3396-46d5-a780-0539d11e5b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:10.247414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd37ced-3396-46d5-a780-0539d11e5b97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:10.248529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd37ced-3396-46d5-a780-0539d11e5b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:10.249991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd37ced-3396-46d5-a780-0539d11e5b97 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:10.251620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 25/56] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:10.257375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415bcff-d551-428d-bed9-d894f8eefbdb None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:10.363161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415bcff-d551-428d-bed9-d894f8eefbdb None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:10.395538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930ef76-ad4c-4ef3-a4ce-0eb8c65e39b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:10.396137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ef76-ad4c-4ef3-a4ce-0eb8c65e39b5 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:10.396417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ef76-ad4c-4ef3-a4ce-0eb8c65e39b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:10.396689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ef76-ad4c-4ef3-a4ce-0eb8c65e39b5 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:10.397319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930ef76-ad4c-4ef3-a4ce-0eb8c65e39b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:10.398748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930ef76-ad4c-4ef3-a4ce-0eb8c65e39b5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:10.413267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:10.486002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 32/57] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Aug 24 07:35:10 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:12.379244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2d7d-a5c8-4240-8fe1-36779e2cc411 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:12.379713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2d7d-a5c8-4240-8fe1-36779e2cc411 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:12.379820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2d7d-a5c8-4240-8fe1-36779e2cc411 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:12.381171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 26/58] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:12.387069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9716ceb-4136-42e0-bb8f-430a4ff12955 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:12.387531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9716ceb-4136-42e0-bb8f-430a4ff12955 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:12.387670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9716ceb-4136-42e0-bb8f-430a4ff12955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:12.405807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a9716ceb-4136-42e0-bb8f-430a4ff12955 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:12.406985 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a9716ceb-4136-42e0-bb8f-430a4ff12955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:12.471158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 33/59] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:12.755306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b2d7d-a5c8-4240-8fe1-36779e2cc411 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:12.859660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b2d7d-a5c8-4240-8fe1-36779e2cc411 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:12.889162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:12.895024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aaf4a-6584-415c-874e-4950990306e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:12.895687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aaf4a-6584-415c-874e-4950990306e2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:12.895969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aaf4a-6584-415c-874e-4950990306e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:12.896241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aaf4a-6584-415c-874e-4950990306e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:12.897348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798aaf4a-6584-415c-874e-4950990306e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:12.900130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798aaf4a-6584-415c-874e-4950990306e2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:12.901630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 27/60] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:12.909161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9716ceb-4136-42e0-bb8f-430a4ff12955 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:13.028612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9716ceb-4136-42e0-bb8f-430a4ff12955 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:13.056999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:13.067830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead24e2d-79ea-4a17-aed2-94d5e446a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:13.068456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead24e2d-79ea-4a17-aed2-94d5e446a025 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:13.068743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead24e2d-79ea-4a17-aed2-94d5e446a025 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:13.069027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead24e2d-79ea-4a17-aed2-94d5e446a025 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:13.069679 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead24e2d-79ea-4a17-aed2-94d5e446a025 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:13.071461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead24e2d-79ea-4a17-aed2-94d5e446a025 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:13.190667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 34/61] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:35:12 2022] POST /identity/v3/users => generated 275 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:16.232616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1980f2-872a-4ef0-9e47-a2f89b49dd77 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:16.233117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1980f2-872a-4ef0-9e47-a2f89b49dd77 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:16.233189 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1980f2-872a-4ef0-9e47-a2f89b49dd77 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:16.234655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 28/62] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:16.248865 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634d88-7055-4a60-8db2-ba727424cb18 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:16.249758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634d88-7055-4a60-8db2-ba727424cb18 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:16.250235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634d88-7055-4a60-8db2-ba727424cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:16.276990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6a634d88-7055-4a60-8db2-ba727424cb18 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:16.278550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6a634d88-7055-4a60-8db2-ba727424cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:16.346235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110062-0118-4ba4-ae44-d2b0542ee23e None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:16.346859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110062-0118-4ba4-ae44-d2b0542ee23e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:16.347386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110062-0118-4ba4-ae44-d2b0542ee23e None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:16.348935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 29/63] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:16.357873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f780740-3c01-4559-a787-5e5a0edf1837 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:16.363310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f780740-3c01-4559-a787-5e5a0edf1837 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:16.363310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f780740-3c01-4559-a787-5e5a0edf1837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:16.376468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 35/64] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:16.396203 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2f780740-3c01-4559-a787-5e5a0edf1837 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:16.397748 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2f780740-3c01-4559-a787-5e5a0edf1837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:16.503330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 30/65] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:16.533080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873e1cc-0f60-4d85-bc00-28ded1904444 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:16.533363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873e1cc-0f60-4d85-bc00-28ded1904444 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:16.533653 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873e1cc-0f60-4d85-bc00-28ded1904444 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:16.535018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 36/66] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:16.540543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fa333-deb8-479b-bb4d-1a6bc5ef84c8 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:16.540842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fa333-deb8-479b-bb4d-1a6bc5ef84c8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:16.541120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fa333-deb8-479b-bb4d-1a6bc5ef84c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:16.567395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-701fa333-deb8-479b-bb4d-1a6bc5ef84c8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:16.568657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-701fa333-deb8-479b-bb4d-1a6bc5ef84c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:16.667272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 31/67] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:16.724462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1898cf-af1e-4581-a3b6-b66f93c63596 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:16.725067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1898cf-af1e-4581-a3b6-b66f93c63596 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:16.725539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1898cf-af1e-4581-a3b6-b66f93c63596 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:16.727830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 37/68] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:16.733458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816922c3-0309-40ea-b291-11653628e5bd None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:16.733751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816922c3-0309-40ea-b291-11653628e5bd None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:16.734033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816922c3-0309-40ea-b291-11653628e5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:16.755527 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-816922c3-0309-40ea-b291-11653628e5bd None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:16.756643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-816922c3-0309-40ea-b291-11653628e5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:16.792110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1898cf-af1e-4581-a3b6-b66f93c63596 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:16.852163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:16.878288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 32/69] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:16.934055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816922c3-0309-40ea-b291-11653628e5bd None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:16.950867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1898cf-af1e-4581-a3b6-b66f93c63596 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:16.963648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:16.992061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0237874-6faa-42ac-bfc1-ab36a1ca7c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:16.993341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0237874-6faa-42ac-bfc1-ab36a1ca7c97 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:16.993700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0237874-6faa-42ac-bfc1-ab36a1ca7c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:16.994120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0237874-6faa-42ac-bfc1-ab36a1ca7c97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.011874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0237874-6faa-42ac-bfc1-ab36a1ca7c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-c0237874-6faa-42ac-bfc1-ab36a1ca7c97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:17.020132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:17.020979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:17.021710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 38/70] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:17.024334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0237874-6faa-42ac-bfc1-ab36a1ca7c97 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.082993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816922c3-0309-40ea-b291-11653628e5bd None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.125083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9f82-84a1-497f-9433-768cc15b0753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.125713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9f82-84a1-497f-9433-768cc15b0753 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.125990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9f82-84a1-497f-9433-768cc15b0753 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.126265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9f82-84a1-497f-9433-768cc15b0753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.137853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be9f82-84a1-497f-9433-768cc15b0753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-11be9f82-84a1-497f-9433-768cc15b0753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:17.142755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:17.143620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:17.144368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:17.144918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0237874-6faa-42ac-bfc1-ab36a1ca7c97 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.144986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 33/71] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:17.144986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9f82-84a1-497f-9433-768cc15b0753 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.185526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac9125-b79b-4d3a-9775-1b77de01fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.186166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac9125-b79b-4d3a-9775-1b77de01fb56 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.186449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac9125-b79b-4d3a-9775-1b77de01fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.186785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac9125-b79b-4d3a-9775-1b77de01fb56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.196216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:17.197718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac9125-b79b-4d3a-9775-1b77de01fb56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-58ac9125-b79b-4d3a-9775-1b77de01fb56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:17.202502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:17.203362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 39/72] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:17.212558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cecc-a242-4492-af5f-5b37ec79c32a None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.213228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cecc-a242-4492-af5f-5b37ec79c32a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.213228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cecc-a242-4492-af5f-5b37ec79c32a None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.213228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 40/73] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:17.213228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cecc-a242-4492-af5f-5b37ec79c32a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.237190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:17.257067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9f82-84a1-497f-9433-768cc15b0753 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.291688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c626b-a285-4a98-a7dc-7d7c7783e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.292212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c626b-a285-4a98-a7dc-7d7c7783e648 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.292617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c626b-a285-4a98-a7dc-7d7c7783e648 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.292893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c626b-a285-4a98-a7dc-7d7c7783e648 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.293553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c626b-a285-4a98-a7dc-7d7c7783e648 None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:17.293857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c626b-a285-4a98-a7dc-7d7c7783e648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:17.295251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c626b-a285-4a98-a7dc-7d7c7783e648 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:17.307216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 34/74] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:17.308054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c626b-a285-4a98-a7dc-7d7c7783e648 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.316193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cecc-a242-4492-af5f-5b37ec79c32a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.356631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fbe79-3977-40a8-927e-8c4523ac9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.356631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fbe79-3977-40a8-927e-8c4523ac9e16 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.356631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fbe79-3977-40a8-927e-8c4523ac9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.356954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fbe79-3977-40a8-927e-8c4523ac9e16 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.357634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fbe79-3977-40a8-927e-8c4523ac9e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:17.358077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fbe79-3977-40a8-927e-8c4523ac9e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:17.360020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fbe79-3977-40a8-927e-8c4523ac9e16 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:17.371167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 41/75] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:17.373259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fbe79-3977-40a8-927e-8c4523ac9e16 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.414026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c626b-a285-4a98-a7dc-7d7c7783e648 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.424597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:17.448654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe22f2-7296-463c-a1c4-b64ca5fbfa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.449280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe22f2-7296-463c-a1c4-b64ca5fbfa77 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.449587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe22f2-7296-463c-a1c4-b64ca5fbfa77 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.449868 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe22f2-7296-463c-a1c4-b64ca5fbfa77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.459873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe22f2-7296-463c-a1c4-b64ca5fbfa77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-d6fe22f2-7296-463c-a1c4-b64ca5fbfa77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:17.465169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:17.466086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:17.466805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:17.467827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 35/76] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:17.468419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:17.468933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d335-325e-4ce9-a1be-279eb6f920fe None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.469223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d335-325e-4ce9-a1be-279eb6f920fe None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.469513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d335-325e-4ce9-a1be-279eb6f920fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.480857 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fbe79-3977-40a8-927e-8c4523ac9e16 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.487167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1c07d335-325e-4ce9-a1be-279eb6f920fe None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:17.488413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1c07d335-325e-4ce9-a1be-279eb6f920fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:17.514279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9107-39c3-42da-bfdb-b66564808115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.514889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9107-39c3-42da-bfdb-b66564808115 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.515173 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9107-39c3-42da-bfdb-b66564808115 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.515485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9107-39c3-42da-bfdb-b66564808115 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.516149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9107-39c3-42da-bfdb-b66564808115 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:17.516460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9107-39c3-42da-bfdb-b66564808115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:17.517836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9107-39c3-42da-bfdb-b66564808115 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:17.526177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 42/77] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:17.526961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9107-39c3-42da-bfdb-b66564808115 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.557351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 36/78] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:17.558129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07d335-325e-4ce9-a1be-279eb6f920fe None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.636353 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9107-39c3-42da-bfdb-b66564808115 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.671120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:17.673696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0fe22-fed7-4ea5-9888-1805cafc4513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.674328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0fe22-fed7-4ea5-9888-1805cafc4513 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.674495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07d335-325e-4ce9-a1be-279eb6f920fe None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.674596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0fe22-fed7-4ea5-9888-1805cafc4513 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.674870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0fe22-fed7-4ea5-9888-1805cafc4513 None admin] PATH_INFO: `/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.690328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0fe22-fed7-4ea5-9888-1805cafc4513 None admin] RBAC: Authorizing `identity:get_user(user_id=68a49a46fc8d49ef97ff34e2e36f8ba8)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:17.691847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0fe22-fed7-4ea5-9888-1805cafc4513 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:17.698964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 43/79] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:17.698964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0fe22-fed7-4ea5-9888-1805cafc4513 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.711905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:17.714881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b75e0e-93b3-4ab2-ba69-f9eb70c60d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.715620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b75e0e-93b3-4ab2-ba69-f9eb70c60d04 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.715978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b75e0e-93b3-4ab2-ba69-f9eb70c60d04 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.716322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b75e0e-93b3-4ab2-ba69-f9eb70c60d04 None admin] PATH_INFO: `/v3/users/46428667f2c84b109fb9821da86b0938` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.717557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b75e0e-93b3-4ab2-ba69-f9eb70c60d04 None admin] RBAC: Authorizing `identity:get_user(user_id=46428667f2c84b109fb9821da86b0938)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:17.719081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b75e0e-93b3-4ab2-ba69-f9eb70c60d04 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:17.720821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 37/80] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/users/46428667f2c84b109fb9821da86b0938 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:17.726060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b75e0e-93b3-4ab2-ba69-f9eb70c60d04 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.807472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0fe22-fed7-4ea5-9888-1805cafc4513 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.826787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b75e0e-93b3-4ab2-ba69-f9eb70c60d04 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.846634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747d3bd-71ce-4be0-97d1-633f89fc5853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.847740 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747d3bd-71ce-4be0-97d1-633f89fc5853 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.848113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747d3bd-71ce-4be0-97d1-633f89fc5853 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.848395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747d3bd-71ce-4be0-97d1-633f89fc5853 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.849072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747d3bd-71ce-4be0-97d1-633f89fc5853 None admin] RBAC: Adding query filter params (name=member) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:17.849379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747d3bd-71ce-4be0-97d1-633f89fc5853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:17.850784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747d3bd-71ce-4be0-97d1-633f89fc5853 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:17.858906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 44/81] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:17.863372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747d3bd-71ce-4be0-97d1-633f89fc5853 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.864192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74433-7004-4674-ba73-3f7e2f0e3d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:17.864821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74433-7004-4674-ba73-3f7e2f0e3d80 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:17.865104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74433-7004-4674-ba73-3f7e2f0e3d80 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:17.865388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74433-7004-4674-ba73-3f7e2f0e3d80 None admin] PATH_INFO: `/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:17.866503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e74433-7004-4674-ba73-3f7e2f0e3d80 None admin] RBAC: Authorizing `identity:get_user(user_id=68a49a46fc8d49ef97ff34e2e36f8ba8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:17.868638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e74433-7004-4674-ba73-3f7e2f0e3d80 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:17.870375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 38/82] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:17.871045 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74433-7004-4674-ba73-3f7e2f0e3d80 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:17.906978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:17.940915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:17.965349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747d3bd-71ce-4be0-97d1-633f89fc5853 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.971123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74433-7004-4674-ba73-3f7e2f0e3d80 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:17.999464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0646d-8943-40f1-8860-574742fa0dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:18.000077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0646d-8943-40f1-8860-574742fa0dbc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:18.000365 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0646d-8943-40f1-8860-574742fa0dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:18.000646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0646d-8943-40f1-8860-574742fa0dbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:18.004577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d12b20-14ca-461e-9f82-b74882c403fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:18.005176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d12b20-14ca-461e-9f82-b74882c403fa None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:18.005469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d12b20-14ca-461e-9f82-b74882c403fa None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:18.005727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d12b20-14ca-461e-9f82-b74882c403fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:18.070019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0646d-8943-40f1-8860-574742fa0dbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:18.072162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0646d-8943-40f1-8860-574742fa0dbc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:18.073105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d12b20-14ca-461e-9f82-b74882c403fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:18.075490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d12b20-14ca-461e-9f82-b74882c403fa None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:18.109032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:18.145830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:18.171144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 45/83] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:18.172111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0646d-8943-40f1-8860-574742fa0dbc None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:18.173278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 39/84] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:18.174019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d12b20-14ca-461e-9f82-b74882c403fa None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:18.273179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d12b20-14ca-461e-9f82-b74882c403fa None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:18.276012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0646d-8943-40f1-8860-574742fa0dbc None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:18.311758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f05101-d6fc-4fd9-becd-67d61dd9a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:18.312391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f05101-d6fc-4fd9-becd-67d61dd9a493 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:18.312669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f05101-d6fc-4fd9-becd-67d61dd9a493 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:18.312973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f05101-d6fc-4fd9-becd-67d61dd9a493 None admin] PATH_INFO: `/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:18.313098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2270601-afe1-4ca1-acdf-3d08dc23fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:18.313733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2270601-afe1-4ca1-acdf-3d08dc23fd7b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:18.314016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2270601-afe1-4ca1-acdf-3d08dc23fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:18.314099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f05101-d6fc-4fd9-becd-67d61dd9a493 None admin] RBAC: Authorizing `identity:get_user(user_id=68a49a46fc8d49ef97ff34e2e36f8ba8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:18.314290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2270601-afe1-4ca1-acdf-3d08dc23fd7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:18.315469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2270601-afe1-4ca1-acdf-3d08dc23fd7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:18.315580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f05101-d6fc-4fd9-becd-67d61dd9a493 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:18.316907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2270601-afe1-4ca1-acdf-3d08dc23fd7b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:18.323618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 40/85] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:18 2022] GET /identity/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:18.323755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 46/86] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:18.323755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2270601-afe1-4ca1-acdf-3d08dc23fd7b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:18.323893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f05101-d6fc-4fd9-becd-67d61dd9a493 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:18.325276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:18.374494 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:18.426170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f05101-d6fc-4fd9-becd-67d61dd9a493 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:18.429360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2270601-afe1-4ca1-acdf-3d08dc23fd7b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:18.459270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6264e2-c6d9-405b-9a2d-3fc3200be295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:18.459895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6264e2-c6d9-405b-9a2d-3fc3200be295 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:18.460176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6264e2-c6d9-405b-9a2d-3fc3200be295 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:18.460452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6264e2-c6d9-405b-9a2d-3fc3200be295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:18.463530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdfd9f-2a77-4a37-ac21-4563844a726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:18.464155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdfd9f-2a77-4a37-ac21-4563844a726a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:18.464442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdfd9f-2a77-4a37-ac21-4563844a726a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:18.464718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdfd9f-2a77-4a37-ac21-4563844a726a None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:18.465839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdfd9f-2a77-4a37-ac21-4563844a726a None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:18.467312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdfd9f-2a77-4a37-ac21-4563844a726a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:18.469202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 47/87] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:18 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:18.469728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdfd9f-2a77-4a37-ac21-4563844a726a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:18.529189 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6264e2-c6d9-405b-9a2d-3fc3200be295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:18.530669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6264e2-c6d9-405b-9a2d-3fc3200be295 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:18.533282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:18.570502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdfd9f-2a77-4a37-ac21-4563844a726a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:18.580855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:18.605624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a4ca-adc9-4714-99e0-a18f04bcef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:18.606246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a4ca-adc9-4714-99e0-a18f04bcef04 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:18.606525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a4ca-adc9-4714-99e0-a18f04bcef04 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:18.606795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492a4ca-adc9-4714-99e0-a18f04bcef04 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:18.608008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492a4ca-adc9-4714-99e0-a18f04bcef04 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:18.609490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492a4ca-adc9-4714-99e0-a18f04bcef04 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:18.611165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 48/88] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:18 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:18.612390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a4ca-adc9-4714-99e0-a18f04bcef04 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:18.637931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 41/89] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:18.637931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6264e2-c6d9-405b-9a2d-3fc3200be295 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:18.723963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492a4ca-adc9-4714-99e0-a18f04bcef04 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:18.736685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6264e2-c6d9-405b-9a2d-3fc3200be295 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:18.739005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:18.758050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c574294-87e2-43de-8102-7a446810362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:18.758654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c574294-87e2-43de-8102-7a446810362a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:18.758938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c574294-87e2-43de-8102-7a446810362a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:18.759213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c574294-87e2-43de-8102-7a446810362a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:18.770339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f58ec-a4c5-46a8-b83f-de01312c684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:18.770945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f58ec-a4c5-46a8-b83f-de01312c684d None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:18.771227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f58ec-a4c5-46a8-b83f-de01312c684d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:18.771538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f58ec-a4c5-46a8-b83f-de01312c684d None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:18.772182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f58ec-a4c5-46a8-b83f-de01312c684d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:18.774256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f58ec-a4c5-46a8-b83f-de01312c684d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:18.804858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:18.825932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c574294-87e2-43de-8102-7a446810362a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:18.827445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c574294-87e2-43de-8102-7a446810362a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:18.856202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 42/90] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:35:18 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:18.857025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f58ec-a4c5-46a8-b83f-de01312c684d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:18.948468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 49/91] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:18.949526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c574294-87e2-43de-8102-7a446810362a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:18.980293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f58ec-a4c5-46a8-b83f-de01312c684d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:19.025213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f026ff5-56db-4918-ac97-48ce0bfaf3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:19.026017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f026ff5-56db-4918-ac97-48ce0bfaf3f0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:19.026464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f026ff5-56db-4918-ac97-48ce0bfaf3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:19.026930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f026ff5-56db-4918-ac97-48ce0bfaf3f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:19.028424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f026ff5-56db-4918-ac97-48ce0bfaf3f0 None admin] RBAC: Adding query filter params (role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=5f268518677d45a2953a77368e9f5965, user.id=68a49a46fc8d49ef97ff34e2e36f8ba8) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:19.029094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f026ff5-56db-4918-ac97-48ce0bfaf3f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:19.031068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f026ff5-56db-4918-ac97-48ce0bfaf3f0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:19.043282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:19.044730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 43/92] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:18 2022] GET /identity/v3/role_assignments?user.id=68a49a46fc8d49ef97ff34e2e36f8ba8&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:19.045954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f026ff5-56db-4918-ac97-48ce0bfaf3f0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:19.073096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c574294-87e2-43de-8102-7a446810362a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:19.090617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:19.115441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e471-1a14-43a5-add8-1ae48b37b7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:19.115639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e471-1a14-43a5-add8-1ae48b37b7e3 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:19.115825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e471-1a14-43a5-add8-1ae48b37b7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:19.116147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e471-1a14-43a5-add8-1ae48b37b7e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:19.116891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e471-1a14-43a5-add8-1ae48b37b7e3 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=5f268518677d45a2953a77368e9f5965, user.id=46428667f2c84b109fb9821da86b0938) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:19.117227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e471-1a14-43a5-add8-1ae48b37b7e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:19.120253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e471-1a14-43a5-add8-1ae48b37b7e3 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:19.128297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 50/93] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:18 2022] GET /identity/v3/role_assignments?user.id=46428667f2c84b109fb9821da86b0938&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:19.129174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e471-1a14-43a5-add8-1ae48b37b7e3 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:19.200534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f026ff5-56db-4918-ac97-48ce0bfaf3f0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:19.256551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1167c-ec5d-493f-ba41-efc62c7e5876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:19.257640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1167c-ec5d-493f-ba41-efc62c7e5876 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:19.258321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1167c-ec5d-493f-ba41-efc62c7e5876 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:19.258812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1167c-ec5d-493f-ba41-efc62c7e5876 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:19.261552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1167c-ec5d-493f-ba41-efc62c7e5876 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:19.263685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1167c-ec5d-493f-ba41-efc62c7e5876 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:19.266798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 44/94] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:19 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:19.276400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1167c-ec5d-493f-ba41-efc62c7e5876 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:19.277677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e471-1a14-43a5-add8-1ae48b37b7e3 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:19.324926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f6e16-e015-44ce-9585-5dbe81267710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:19.325660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f6e16-e015-44ce-9585-5dbe81267710 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:19.325846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f6e16-e015-44ce-9585-5dbe81267710 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:19.326126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f6e16-e015-44ce-9585-5dbe81267710 None admin] PATH_INFO: `/v3/projects/addd8e4a934c47c5b0752e42925db7a7` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:19.327282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f6e16-e015-44ce-9585-5dbe81267710 None admin] RBAC: Authorizing `identity:get_project(project_id=addd8e4a934c47c5b0752e42925db7a7)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:19.329535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f6e16-e015-44ce-9585-5dbe81267710 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:19.331834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 51/95] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:19 2022] GET /identity/v3/projects/addd8e4a934c47c5b0752e42925db7a7 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:19.340396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f6e16-e015-44ce-9585-5dbe81267710 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:19.363776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:19.423755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:19.438859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1167c-ec5d-493f-ba41-efc62c7e5876 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:19.509966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b53a-d51f-4c48-86c1-e293d555caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:19.510971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b53a-d51f-4c48-86c1-e293d555caa1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:19.511489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b53a-d51f-4c48-86c1-e293d555caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:19.511965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b53a-d51f-4c48-86c1-e293d555caa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:19.513551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b53a-d51f-4c48-86c1-e293d555caa1 None admin] RBAC: Adding query filter params (role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=5f268518677d45a2953a77368e9f5965, user.id=68a49a46fc8d49ef97ff34e2e36f8ba8) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:19.514075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b53a-d51f-4c48-86c1-e293d555caa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:19.516239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b53a-d51f-4c48-86c1-e293d555caa1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:19.521481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f6e16-e015-44ce-9585-5dbe81267710 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:19.524004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 45/96] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:19 2022] GET /identity/v3/role_assignments?user.id=68a49a46fc8d49ef97ff34e2e36f8ba8&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:19.573109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014bab3-9e7f-4e82-8e97-fe64c558f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:19.573738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bab3-9e7f-4e82-8e97-fe64c558f575 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:19.574022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bab3-9e7f-4e82-8e97-fe64c558f575 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:19.574298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014bab3-9e7f-4e82-8e97-fe64c558f575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:19.575045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014bab3-9e7f-4e82-8e97-fe64c558f575 None admin] RBAC: Adding query filter params (role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=addd8e4a934c47c5b0752e42925db7a7, user.id=68a49a46fc8d49ef97ff34e2e36f8ba8) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:19.575384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014bab3-9e7f-4e82-8e97-fe64c558f575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:19.576994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014bab3-9e7f-4e82-8e97-fe64c558f575 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:19.583471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 52/97] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:19 2022] GET /identity/v3/role_assignments?user.id=68a49a46fc8d49ef97ff34e2e36f8ba8&scope.project.id=addd8e4a934c47c5b0752e42925db7a7&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:21.620827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509278-f731-40fd-9f60-dde250cd2dc6 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:21.621303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509278-f731-40fd-9f60-dde250cd2dc6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:21.621303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36509278-f731-40fd-9f60-dde250cd2dc6 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:21.622651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 46/98] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:21.628144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb429-8b52-4a60-8736-07935370108d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:21.628560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb429-8b52-4a60-8736-07935370108d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:21.628728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbb429-8b52-4a60-8736-07935370108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:21.659353 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-68dbb429-8b52-4a60-8736-07935370108d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:21.660554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-68dbb429-8b52-4a60-8736-07935370108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:21.752541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 53/99] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:21.825274 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97ae0f-a243-45e7-99a0-5204ae1ea9da None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:21.825923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97ae0f-a243-45e7-99a0-5204ae1ea9da None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:21.826423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97ae0f-a243-45e7-99a0-5204ae1ea9da None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:21.828274 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 47/100] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:21.833602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6444459-18a3-48db-96d1-1b3065c85b27 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:21.833892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6444459-18a3-48db-96d1-1b3065c85b27 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:21.834167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6444459-18a3-48db-96d1-1b3065c85b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:21.843700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:21.859026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d6444459-18a3-48db-96d1-1b3065c85b27 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:21.860260 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d6444459-18a3-48db-96d1-1b3065c85b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:21.948656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 54/101] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:22.115228 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48228d9c-dbbd-425a-b150-60ed5ed8bfb2 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.115887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48228d9c-dbbd-425a-b150-60ed5ed8bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.116390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48228d9c-dbbd-425a-b150-60ed5ed8bfb2 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.118576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 48/102] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:22.123991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590907-0bb8-4817-b1df-be852f1fd2d5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.124286 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590907-0bb8-4817-b1df-be852f1fd2d5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.124566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590907-0bb8-4817-b1df-be852f1fd2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.151408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e8590907-0bb8-4817-b1df-be852f1fd2d5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:22.152596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e8590907-0bb8-4817-b1df-be852f1fd2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:22.187337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48228d9c-dbbd-425a-b150-60ed5ed8bfb2 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:22.263039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 55/103] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:22.371136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48228d9c-dbbd-425a-b150-60ed5ed8bfb2 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:22.417510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bfc78-647f-426a-8d3c-998e96433eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:22.418195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bfc78-647f-426a-8d3c-998e96433eca None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.418479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bfc78-647f-426a-8d3c-998e96433eca None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.418750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bfc78-647f-426a-8d3c-998e96433eca None admin] PATH_INFO: `/v3/domains/default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.421842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bfc78-647f-426a-8d3c-998e96433eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:22.423364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bfc78-647f-426a-8d3c-998e96433eca None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:22.425238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 49/104] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:22.433610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8590907-0bb8-4817-b1df-be852f1fd2d5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:22.436914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bfc78-647f-426a-8d3c-998e96433eca None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:22.481175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:22.552406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:22.567946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bfc78-647f-426a-8d3c-998e96433eca None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:22.612733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed862037-ce2a-40d3-a439-d329bcee9e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:22.613595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed862037-ce2a-40d3-a439-d329bcee9e32 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.614044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed862037-ce2a-40d3-a439-d329bcee9e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.614456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed862037-ce2a-40d3-a439-d329bcee9e32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.632809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed862037-ce2a-40d3-a439-d329bcee9e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:22.637242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8590907-0bb8-4817-b1df-be852f1fd2d5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-ed862037-ce2a-40d3-a439-d329bcee9e32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:22.639508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:22.640539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:22.641490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 50/105] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:22.642236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74777b-11a4-4ba7-8ab4-5b11890c3125 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.642648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74777b-11a4-4ba7-8ab4-5b11890c3125 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.647752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74777b-11a4-4ba7-8ab4-5b11890c3125 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.647752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 51/106] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:22.647752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d458-1c32-47c5-b05b-f977b23410db None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.647752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d458-1c32-47c5-b05b-f977b23410db None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.647752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d458-1c32-47c5-b05b-f977b23410db None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.648636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 52/107] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:22.651773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178d458-1c32-47c5-b05b-f977b23410db None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:22.687604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856cdfd-d69a-4ddb-840a-c2e26a077e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:22.688214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856cdfd-d69a-4ddb-840a-c2e26a077e2f None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.688495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856cdfd-d69a-4ddb-840a-c2e26a077e2f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.688765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856cdfd-d69a-4ddb-840a-c2e26a077e2f None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.689414 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856cdfd-d69a-4ddb-840a-c2e26a077e2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:22.690883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856cdfd-d69a-4ddb-840a-c2e26a077e2f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:22.745509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:22.759925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 56/108] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:35:22 2022] POST /identity/v3/projects => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:22.761172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dc707-2411-4793-83ae-38d4ff298b8f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.761465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dc707-2411-4793-83ae-38d4ff298b8f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.761800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dc707-2411-4793-83ae-38d4ff298b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.762004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178d458-1c32-47c5-b05b-f977b23410db None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:22.781375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ab4dc707-2411-4793-83ae-38d4ff298b8f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:22.782648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ab4dc707-2411-4793-83ae-38d4ff298b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:22.803707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7824d8-5650-4504-87c7-ebfde0f6d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:22.804230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7824d8-5650-4504-87c7-ebfde0f6d09b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.805860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7824d8-5650-4504-87c7-ebfde0f6d09b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.806285 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7824d8-5650-4504-87c7-ebfde0f6d09b None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.806993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7824d8-5650-4504-87c7-ebfde0f6d09b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:22.807337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7824d8-5650-4504-87c7-ebfde0f6d09b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:22.808824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7824d8-5650-4504-87c7-ebfde0f6d09b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:22.818314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 53/109] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:22.819719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cadec2-3dc8-4a20-a982-4d03b3ac4d8c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.820116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cadec2-3dc8-4a20-a982-4d03b3ac4d8c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.820692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cadec2-3dc8-4a20-a982-4d03b3ac4d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.843125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d9cadec2-3dc8-4a20-a982-4d03b3ac4d8c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:22.844805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d9cadec2-3dc8-4a20-a982-4d03b3ac4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:22.871555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 57/110] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:22.880380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dc707-2411-4793-83ae-38d4ff298b8f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:22.938702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 54/111] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:22.939477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:22.941681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5362e-d08c-45c9-91cb-70eb9fc4aaea None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:22.942043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5362e-d08c-45c9-91cb-70eb9fc4aaea None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:22.942394 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5362e-d08c-45c9-91cb-70eb9fc4aaea None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:22.944624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 55/112] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:22.945628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5362e-d08c-45c9-91cb-70eb9fc4aaea None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.000021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dc707-2411-4793-83ae-38d4ff298b8f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:23.037103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43478dfc-111a-4890-9cb2-08e75e5de17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:23.038055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478dfc-111a-4890-9cb2-08e75e5de17c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.038320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:23.039390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478dfc-111a-4890-9cb2-08e75e5de17c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.039953 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478dfc-111a-4890-9cb2-08e75e5de17c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.050963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43478dfc-111a-4890-9cb2-08e75e5de17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-43478dfc-111a-4890-9cb2-08e75e5de17c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:23.056957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:23.057771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:23.058518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:23.060838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 58/113] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:35:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:23.062828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bbdce-49da-4a05-b1cb-bd61d49d4d04 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.063282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bbdce-49da-4a05-b1cb-bd61d49d4d04 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.063789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bbdce-49da-4a05-b1cb-bd61d49d4d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.068105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5362e-d08c-45c9-91cb-70eb9fc4aaea None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:23.087875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d99bbdce-49da-4a05-b1cb-bd61d49d4d04 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:23.089425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d99bbdce-49da-4a05-b1cb-bd61d49d4d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:23.139563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdee8b-d8a0-4cbe-a3e2-d7ce5fa5f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:23.140492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdee8b-d8a0-4cbe-a3e2-d7ce5fa5f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.140946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdee8b-d8a0-4cbe-a3e2-d7ce5fa5f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.141425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdee8b-d8a0-4cbe-a3e2-d7ce5fa5f8e1 None admin] PATH_INFO: `/v3/users/46428667f2c84b109fb9821da86b0938` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.142763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdee8b-d8a0-4cbe-a3e2-d7ce5fa5f8e1 None admin] RBAC: Authorizing `identity:get_user(user_id=46428667f2c84b109fb9821da86b0938)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:23.144923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdee8b-d8a0-4cbe-a3e2-d7ce5fa5f8e1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:23.150003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 56/114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:22 2022] GET /identity/v3/users/46428667f2c84b109fb9821da86b0938 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:23.153574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdee8b-d8a0-4cbe-a3e2-d7ce5fa5f8e1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.200508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 59/115] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:23.201674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bbdce-49da-4a05-b1cb-bd61d49d4d04 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.263695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:23.287581 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdee8b-d8a0-4cbe-a3e2-d7ce5fa5f8e1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:23.328386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b824b-2e88-41cd-a5c7-107bf8da1865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:23.329263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b824b-2e88-41cd-a5c7-107bf8da1865 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.329693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b824b-2e88-41cd-a5c7-107bf8da1865 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.330210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b824b-2e88-41cd-a5c7-107bf8da1865 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.331001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b824b-2e88-41cd-a5c7-107bf8da1865 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:23.331462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b824b-2e88-41cd-a5c7-107bf8da1865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:23.333042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b824b-2e88-41cd-a5c7-107bf8da1865 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:23.345700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 57/116] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:35:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:23.347057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b824b-2e88-41cd-a5c7-107bf8da1865 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.358268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bbdce-49da-4a05-b1cb-bd61d49d4d04 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:23.362899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:23.400354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289161c-a8dc-48c3-9af6-b1e24c4820e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:23.401055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289161c-a8dc-48c3-9af6-b1e24c4820e6 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.401349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289161c-a8dc-48c3-9af6-b1e24c4820e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.401631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289161c-a8dc-48c3-9af6-b1e24c4820e6 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.402901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289161c-a8dc-48c3-9af6-b1e24c4820e6 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:23.404780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289161c-a8dc-48c3-9af6-b1e24c4820e6 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:23.411433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 60/117] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:23 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:23.412393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289161c-a8dc-48c3-9af6-b1e24c4820e6 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.483651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b824b-2e88-41cd-a5c7-107bf8da1865 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:23.527240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289161c-a8dc-48c3-9af6-b1e24c4820e6 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:23.530617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:23.531090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ab377-e63b-43b6-8611-5bcae6a296b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:23.532090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ab377-e63b-43b6-8611-5bcae6a296b2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.532374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ab377-e63b-43b6-8611-5bcae6a296b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.532655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ab377-e63b-43b6-8611-5bcae6a296b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.544251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ab377-e63b-43b6-8611-5bcae6a296b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-7b3ab377-e63b-43b6-8611-5bcae6a296b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:23.549456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:23.550317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:23.551066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 58/118] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:23.552597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ab377-e63b-43b6-8611-5bcae6a296b2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.568123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4ed7-c300-4d4a-8fdd-9042fa0f21d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:23.568757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4ed7-c300-4d4a-8fdd-9042fa0f21d5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.569042 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4ed7-c300-4d4a-8fdd-9042fa0f21d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.569319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4ed7-c300-4d4a-8fdd-9042fa0f21d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.580769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf4ed7-c300-4d4a-8fdd-9042fa0f21d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-69bf4ed7-c300-4d4a-8fdd-9042fa0f21d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:23.586420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:23.587444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 61/119] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:23.588377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4ed7-c300-4d4a-8fdd-9042fa0f21d5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.631162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:23.668025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ab377-e63b-43b6-8611-5bcae6a296b2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:23.693795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4ed7-c300-4d4a-8fdd-9042fa0f21d5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:23.707660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f693b-9969-4c5e-a84c-665a6892c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:23.708361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f693b-9969-4c5e-a84c-665a6892c99e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.708667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f693b-9969-4c5e-a84c-665a6892c99e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.708906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f693b-9969-4c5e-a84c-665a6892c99e None admin] PATH_INFO: `/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.710138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f693b-9969-4c5e-a84c-665a6892c99e None admin] RBAC: Authorizing `identity:get_user(user_id=68a49a46fc8d49ef97ff34e2e36f8ba8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:23.712365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f693b-9969-4c5e-a84c-665a6892c99e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:23.714096 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 59/120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:23 2022] GET /identity/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:23.714820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f693b-9969-4c5e-a84c-665a6892c99e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.728954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5285c3f-7578-477f-8922-65e0808aaf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:23.729625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5285c3f-7578-477f-8922-65e0808aaf6a None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.729915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5285c3f-7578-477f-8922-65e0808aaf6a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.730196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5285c3f-7578-477f-8922-65e0808aaf6a None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965/users/46428667f2c84b109fb9821da86b0938/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.732173 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5285c3f-7578-477f-8922-65e0808aaf6a None admin] RBAC: Authorizing `identity:create_grant(project_id=5f268518677d45a2953a77368e9f5965, user_id=46428667f2c84b109fb9821da86b0938, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:23.733640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5285c3f-7578-477f-8922-65e0808aaf6a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:23.804365 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 62/121] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:35:23 2022] PUT /identity/v3/projects/5f268518677d45a2953a77368e9f5965/users/46428667f2c84b109fb9821da86b0938/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:23.805485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5285c3f-7578-477f-8922-65e0808aaf6a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.825136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f693b-9969-4c5e-a84c-665a6892c99e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:23.848589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:23.867720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd97e4-5388-4182-9656-92bdbf4be2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:23.868835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd97e4-5388-4182-9656-92bdbf4be2b8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:23.869156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd97e4-5388-4182-9656-92bdbf4be2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:23.869434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd97e4-5388-4182-9656-92bdbf4be2b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:23.871980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:23.884919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd97e4-5388-4182-9656-92bdbf4be2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-b9cd97e4-5388-4182-9656-92bdbf4be2b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:23.889807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:23.890828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 60/122] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:23.896075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd97e4-5388-4182-9656-92bdbf4be2b8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:23.975214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5285c3f-7578-477f-8922-65e0808aaf6a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.018575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb299bf-354a-4cd8-b81d-c3375e449f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.019436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb299bf-354a-4cd8-b81d-c3375e449f60 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.019727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb299bf-354a-4cd8-b81d-c3375e449f60 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.020003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb299bf-354a-4cd8-b81d-c3375e449f60 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.020679 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb299bf-354a-4cd8-b81d-c3375e449f60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:24.020984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb299bf-354a-4cd8-b81d-c3375e449f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.022668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb299bf-354a-4cd8-b81d-c3375e449f60 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:24.033822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 63/123] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:24.036564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd97e4-5388-4182-9656-92bdbf4be2b8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.039326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb299bf-354a-4cd8-b81d-c3375e449f60 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:24.073996 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f02629-d6e6-4daa-bbdc-446db21f9330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.074951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f02629-d6e6-4daa-bbdc-446db21f9330 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.075243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f02629-d6e6-4daa-bbdc-446db21f9330 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.075823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f02629-d6e6-4daa-bbdc-446db21f9330 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.076496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f02629-d6e6-4daa-bbdc-446db21f9330 None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:24.077022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f02629-d6e6-4daa-bbdc-446db21f9330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.079025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f02629-d6e6-4daa-bbdc-446db21f9330 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:24.089950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 61/124] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:24.090996 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f02629-d6e6-4daa-bbdc-446db21f9330 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:24.142112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:24.157625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb299bf-354a-4cd8-b81d-c3375e449f60 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.168046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:24.194181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98730d68-0e33-40d1-a533-111a7cae8cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.195306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98730d68-0e33-40d1-a533-111a7cae8cdc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.195967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98730d68-0e33-40d1-a533-111a7cae8cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.196362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98730d68-0e33-40d1-a533-111a7cae8cdc None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.197644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98730d68-0e33-40d1-a533-111a7cae8cdc None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.199601 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98730d68-0e33-40d1-a533-111a7cae8cdc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:24.201711 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 64/125] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:24 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:24.202984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98730d68-0e33-40d1-a533-111a7cae8cdc None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:24.227119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f02629-d6e6-4daa-bbdc-446db21f9330 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.273503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dc206-f336-4b61-8e7b-5b1a9eb14557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.274642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc206-f336-4b61-8e7b-5b1a9eb14557 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.275485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc206-f336-4b61-8e7b-5b1a9eb14557 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.276049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc206-f336-4b61-8e7b-5b1a9eb14557 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.276971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dc206-f336-4b61-8e7b-5b1a9eb14557 None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:24.277464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dc206-f336-4b61-8e7b-5b1a9eb14557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.279244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dc206-f336-4b61-8e7b-5b1a9eb14557 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:24.290937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 62/126] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:24.292028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dc206-f336-4b61-8e7b-5b1a9eb14557 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:24.326294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98730d68-0e33-40d1-a533-111a7cae8cdc None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.384493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fb5d1-028f-41c1-80c0-9696d90f09f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.385179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb5d1-028f-41c1-80c0-9696d90f09f9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.385607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb5d1-028f-41c1-80c0-9696d90f09f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.385888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb5d1-028f-41c1-80c0-9696d90f09f9 None admin] PATH_INFO: `/v3/users/c29d5993c0074d8d872d0d7063c1e8df` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.405506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fb5d1-028f-41c1-80c0-9696d90f09f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c29d5993c0074d8d872d0d7063c1e8df)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.407765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fb5d1-028f-41c1-80c0-9696d90f09f9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:24.415440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 65/127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:24 2022] GET /identity/v3/users/c29d5993c0074d8d872d0d7063c1e8df => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:24.415440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fb5d1-028f-41c1-80c0-9696d90f09f9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:24.434463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:24.435829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dc206-f336-4b61-8e7b-5b1a9eb14557 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.459059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:24.482892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c58e0-9957-4293-ba89-6e3f24d2e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.483558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c58e0-9957-4293-ba89-6e3f24d2e04c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.483843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c58e0-9957-4293-ba89-6e3f24d2e04c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.484122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c58e0-9957-4293-ba89-6e3f24d2e04c None admin] PATH_INFO: `/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.485323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c58e0-9957-4293-ba89-6e3f24d2e04c None admin] RBAC: Authorizing `identity:get_user(user_id=68a49a46fc8d49ef97ff34e2e36f8ba8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.487910 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c58e0-9957-4293-ba89-6e3f24d2e04c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:24.490469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 63/128] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:24 2022] GET /identity/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:24.495413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c58e0-9957-4293-ba89-6e3f24d2e04c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:24.556480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fb5d1-028f-41c1-80c0-9696d90f09f9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.595596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b1bbf-1fca-41da-81b6-f4e6adca7e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.596361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b1bbf-1fca-41da-81b6-f4e6adca7e6c None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.596651 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b1bbf-1fca-41da-81b6-f4e6adca7e6c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.597111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b1bbf-1fca-41da-81b6-f4e6adca7e6c None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965/users/68a49a46fc8d49ef97ff34e2e36f8ba8/roles/b1bfc74339e44fc983bfb20cbf2bda25` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.599834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b1bbf-1fca-41da-81b6-f4e6adca7e6c None admin] RBAC: Authorizing `identity:create_grant(project_id=5f268518677d45a2953a77368e9f5965, user_id=68a49a46fc8d49ef97ff34e2e36f8ba8, role_id=b1bfc74339e44fc983bfb20cbf2bda25)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.600610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c58e0-9957-4293-ba89-6e3f24d2e04c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.602942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b1bbf-1fca-41da-81b6-f4e6adca7e6c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:24.637173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e6bef-f0dc-4c9e-93b5-7a442f56e31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.637896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e6bef-f0dc-4c9e-93b5-7a442f56e31e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.638241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e6bef-f0dc-4c9e-93b5-7a442f56e31e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.638585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e6bef-f0dc-4c9e-93b5-7a442f56e31e None admin] PATH_INFO: `/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.639810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e6bef-f0dc-4c9e-93b5-7a442f56e31e None admin] RBAC: Authorizing `identity:get_user(user_id=68a49a46fc8d49ef97ff34e2e36f8ba8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.641474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e6bef-f0dc-4c9e-93b5-7a442f56e31e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:24.643345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 64/129] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:24 2022] GET /identity/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:24.643969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e6bef-f0dc-4c9e-93b5-7a442f56e31e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:24.678682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 66/130] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:35:24 2022] PUT /identity/v3/projects/5f268518677d45a2953a77368e9f5965/users/68a49a46fc8d49ef97ff34e2e36f8ba8/roles/b1bfc74339e44fc983bfb20cbf2bda25 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:24.684934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b1bbf-1fca-41da-81b6-f4e6adca7e6c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:24.739671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:24.832208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e6bef-f0dc-4c9e-93b5-7a442f56e31e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.855887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:24.891138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8705d-a9cd-4cf9-af98-4b85f53236a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.892718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8705d-a9cd-4cf9-af98-4b85f53236a8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.893203 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8705d-a9cd-4cf9-af98-4b85f53236a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.893997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8705d-a9cd-4cf9-af98-4b85f53236a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.902619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b1bbf-1fca-41da-81b6-f4e6adca7e6c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:24.952757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35068689-c81a-4d35-904f-5843fd7fd347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:24.953456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35068689-c81a-4d35-904f-5843fd7fd347 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:24.953740 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35068689-c81a-4d35-904f-5843fd7fd347 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:24.954020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35068689-c81a-4d35-904f-5843fd7fd347 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:24.955644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35068689-c81a-4d35-904f-5843fd7fd347 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.957687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35068689-c81a-4d35-904f-5843fd7fd347 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:24.960858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 67/131] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:24 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:24.962206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35068689-c81a-4d35-904f-5843fd7fd347 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:24.993272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8705d-a9cd-4cf9-af98-4b85f53236a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:24.994978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8705d-a9cd-4cf9-af98-4b85f53236a8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:25.058032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:25.087839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35068689-c81a-4d35-904f-5843fd7fd347 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:25.112166 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 65/132] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:25.114570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bbe28-6392-4e5b-bd47-98ce31f87b35 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:25.115049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bbe28-6392-4e5b-bd47-98ce31f87b35 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:25.115796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bbe28-6392-4e5b-bd47-98ce31f87b35 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:25.118161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 66/133] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:25.119045 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bbe28-6392-4e5b-bd47-98ce31f87b35 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:25.125834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d21c8-7773-48d1-a424-4864515eee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:25.126536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d21c8-7773-48d1-a424-4864515eee95 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:25.126821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d21c8-7773-48d1-a424-4864515eee95 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:25.127101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d21c8-7773-48d1-a424-4864515eee95 None admin] PATH_INFO: `/v3/projects/addd8e4a934c47c5b0752e42925db7a7` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:25.128311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d21c8-7773-48d1-a424-4864515eee95 None admin] RBAC: Authorizing `identity:get_project(project_id=addd8e4a934c47c5b0752e42925db7a7)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:25.129772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d21c8-7773-48d1-a424-4864515eee95 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:25.132892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 68/134] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:24 2022] GET /identity/v3/projects/addd8e4a934c47c5b0752e42925db7a7 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:25.134323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d21c8-7773-48d1-a424-4864515eee95 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:25.149972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:25.239443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bbe28-6392-4e5b-bd47-98ce31f87b35 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:25.246899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d21c8-7773-48d1-a424-4864515eee95 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:25.281227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c889-eb6b-4238-b0b4-14f653f848fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:25.282032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c889-eb6b-4238-b0b4-14f653f848fe None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:25.282413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c889-eb6b-4238-b0b4-14f653f848fe None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:25.282955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c889-eb6b-4238-b0b4-14f653f848fe None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965/users/68a49a46fc8d49ef97ff34e2e36f8ba8/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:25.285703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7c889-eb6b-4238-b0b4-14f653f848fe None admin] RBAC: Authorizing `identity:create_grant(project_id=5f268518677d45a2953a77368e9f5965, user_id=68a49a46fc8d49ef97ff34e2e36f8ba8, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:25.287484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7c889-eb6b-4238-b0b4-14f653f848fe None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:25.289410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec42d91-c62f-42c0-a857-306518a36883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:25.290195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec42d91-c62f-42c0-a857-306518a36883 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:25.290615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec42d91-c62f-42c0-a857-306518a36883 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:25.291045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec42d91-c62f-42c0-a857-306518a36883 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:25.292484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec42d91-c62f-42c0-a857-306518a36883 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:25.294190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec42d91-c62f-42c0-a857-306518a36883 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:25.296003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 69/135] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:25 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:25.297578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdecf9-94be-40a9-b0cf-c007c157c43f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:25.298075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdecf9-94be-40a9-b0cf-c007c157c43f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:25.298541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdecf9-94be-40a9-b0cf-c007c157c43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:25.319010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-83bdecf9-94be-40a9-b0cf-c007c157c43f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:25.320680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-83bdecf9-94be-40a9-b0cf-c007c157c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:25.349565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 67/136] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:35:25 2022] PUT /identity/v3/projects/5f268518677d45a2953a77368e9f5965/users/68a49a46fc8d49ef97ff34e2e36f8ba8/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:25.358348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c889-eb6b-4238-b0b4-14f653f848fe None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:25.404239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:25.466667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 70/137] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:25.467888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdecf9-94be-40a9-b0cf-c007c157c43f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:25.478071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:25.557151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c889-eb6b-4238-b0b4-14f653f848fe None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:25.580496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdecf9-94be-40a9-b0cf-c007c157c43f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:25.609230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d3c71-361d-4c45-974a-4a93a742da5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:25.610300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3c71-361d-4c45-974a-4a93a742da5d None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:25.610826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3c71-361d-4c45-974a-4a93a742da5d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:25.611786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3c71-361d-4c45-974a-4a93a742da5d None admin] PATH_INFO: `/v3/projects/addd8e4a934c47c5b0752e42925db7a7/users/68a49a46fc8d49ef97ff34e2e36f8ba8/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:25.613920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d3c71-361d-4c45-974a-4a93a742da5d None admin] RBAC: Authorizing `identity:create_grant(project_id=addd8e4a934c47c5b0752e42925db7a7, user_id=68a49a46fc8d49ef97ff34e2e36f8ba8, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:25.615630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d3c71-361d-4c45-974a-4a93a742da5d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:25.642477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340ea12-fe48-46fd-8533-4200f14b0f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:25.643502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ea12-fe48-46fd-8533-4200f14b0f70 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:25.643998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ea12-fe48-46fd-8533-4200f14b0f70 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:25.644467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ea12-fe48-46fd-8533-4200f14b0f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:25.645418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340ea12-fe48-46fd-8533-4200f14b0f70 None admin] RBAC: Adding query filter params (role.id=eafae458ff434a238f62753799a89414, scope.project.id=5f268518677d45a2953a77368e9f5965, user.id=c29d5993c0074d8d872d0d7063c1e8df) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:25.645967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340ea12-fe48-46fd-8533-4200f14b0f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:25.648253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340ea12-fe48-46fd-8533-4200f14b0f70 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:25.654654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 71/138] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:25 2022] GET /identity/v3/role_assignments?user.id=c29d5993c0074d8d872d0d7063c1e8df&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=eafae458ff434a238f62753799a89414 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:25.691631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 68/139] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:35:25 2022] PUT /identity/v3/projects/addd8e4a934c47c5b0752e42925db7a7/users/68a49a46fc8d49ef97ff34e2e36f8ba8/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:25.923003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6e2f6-6c7c-4751-b0bb-0900b86cf6b8 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:25.923498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6e2f6-6c7c-4751-b0bb-0900b86cf6b8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:25.923498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6e2f6-6c7c-4751-b0bb-0900b86cf6b8 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:25.924991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 72/140] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:25.932316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918430d2-ce02-43b3-a4aa-511eb85cb159 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:25.932316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918430d2-ce02-43b3-a4aa-511eb85cb159 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:25.932316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918430d2-ce02-43b3-a4aa-511eb85cb159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:25.953427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-918430d2-ce02-43b3-a4aa-511eb85cb159 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:25.955026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-918430d2-ce02-43b3-a4aa-511eb85cb159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:25.982263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6e2f6-6c7c-4751-b0bb-0900b86cf6b8 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:26.084368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 69/141] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:26.127677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:26.145948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6e2f6-6c7c-4751-b0bb-0900b86cf6b8 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:26.190092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a69e5-95eb-4f5f-b1f2-f4d496fca9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:26.190647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a69e5-95eb-4f5f-b1f2-f4d496fca9a1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:26.190931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a69e5-95eb-4f5f-b1f2-f4d496fca9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:26.191204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a69e5-95eb-4f5f-b1f2-f4d496fca9a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:26.192468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a69e5-95eb-4f5f-b1f2-f4d496fca9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:26.194072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a69e5-95eb-4f5f-b1f2-f4d496fca9a1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:26.196036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 73/142] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:26.201627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918430d2-ce02-43b3-a4aa-511eb85cb159 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:26.205323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:26.327869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918430d2-ce02-43b3-a4aa-511eb85cb159 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:26.378739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647757c8-05ff-4908-abae-03af7fb06c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:26.379385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647757c8-05ff-4908-abae-03af7fb06c81 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:26.379674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647757c8-05ff-4908-abae-03af7fb06c81 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:26.379955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647757c8-05ff-4908-abae-03af7fb06c81 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:26.380628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647757c8-05ff-4908-abae-03af7fb06c81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:26.382133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647757c8-05ff-4908-abae-03af7fb06c81 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:26.490904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 70/143] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:35:26 2022] POST /identity/v3/users => generated 283 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:26.576831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a69e5-95eb-4f5f-b1f2-f4d496fca9a1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:26.705463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a69e5-95eb-4f5f-b1f2-f4d496fca9a1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:26.750915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382b22-a149-4631-9bc5-1eb555c97ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:26.751510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382b22-a149-4631-9bc5-1eb555c97ef8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:26.751796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382b22-a149-4631-9bc5-1eb555c97ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:26.752071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf382b22-a149-4631-9bc5-1eb555c97ef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:26.760998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:26.765389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf382b22-a149-4631-9bc5-1eb555c97ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-cf382b22-a149-4631-9bc5-1eb555c97ef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:26.770305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:26.771107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:26.771888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 74/144] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:26.777890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647757c8-05ff-4908-abae-03af7fb06c81 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:26.860291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:26.906842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647757c8-05ff-4908-abae-03af7fb06c81 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:26.943483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8d2a-21bb-4562-8e89-7e9d9bbccb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:26.944224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8d2a-21bb-4562-8e89-7e9d9bbccb79 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:26.944381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8d2a-21bb-4562-8e89-7e9d9bbccb79 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:26.944794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8d2a-21bb-4562-8e89-7e9d9bbccb79 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:26.945476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd8d2a-21bb-4562-8e89-7e9d9bbccb79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:26.945784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd8d2a-21bb-4562-8e89-7e9d9bbccb79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:26.947221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd8d2a-21bb-4562-8e89-7e9d9bbccb79 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:26.956529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 71/145] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:26.963066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382b22-a149-4631-9bc5-1eb555c97ef8 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:27.086164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf382b22-a149-4631-9bc5-1eb555c97ef8 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:27.130107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029f8d3-da00-4f48-b51b-ba9311a15f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:27.130750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f8d3-da00-4f48-b51b-ba9311a15f15 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:27.131033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f8d3-da00-4f48-b51b-ba9311a15f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:27.131397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029f8d3-da00-4f48-b51b-ba9311a15f15 None admin] PATH_INFO: `/v3/users/46428667f2c84b109fb9821da86b0938` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:27.135979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029f8d3-da00-4f48-b51b-ba9311a15f15 None admin] RBAC: Authorizing `identity:get_user(user_id=46428667f2c84b109fb9821da86b0938)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:27.137457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029f8d3-da00-4f48-b51b-ba9311a15f15 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:27.139075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 75/146] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:26 2022] GET /identity/v3/users/46428667f2c84b109fb9821da86b0938 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:27.145008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8d2a-21bb-4562-8e89-7e9d9bbccb79 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:27.263836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4362-8813-4deb-b3aa-f49345bb1e00 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:27.264902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4362-8813-4deb-b3aa-f49345bb1e00 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:27.264902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4362-8813-4deb-b3aa-f49345bb1e00 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:27.266530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 76/147] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:27.268519 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8d2a-21bb-4562-8e89-7e9d9bbccb79 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:27.271674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef763-5c1f-4a96-98e9-234fb7d7cb5d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:27.272180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef763-5c1f-4a96-98e9-234fb7d7cb5d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:27.272800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ef763-5c1f-4a96-98e9-234fb7d7cb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:27.316375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-bf4ef763-5c1f-4a96-98e9-234fb7d7cb5d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:27.317580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bf4ef763-5c1f-4a96-98e9-234fb7d7cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:27.327637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:27.349288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806ea55-c0e9-47d4-976a-ae8f8f7d5c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:27.349288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806ea55-c0e9-47d4-976a-ae8f8f7d5c06 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:27.349288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806ea55-c0e9-47d4-976a-ae8f8f7d5c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:27.349288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806ea55-c0e9-47d4-976a-ae8f8f7d5c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:27.431250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:27.450719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 77/148] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:27.466277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806ea55-c0e9-47d4-976a-ae8f8f7d5c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:27.467903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806ea55-c0e9-47d4-976a-ae8f8f7d5c06 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:27.583336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 72/149] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:27.590137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef763-5c1f-4a96-98e9-234fb7d7cb5d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:27.713451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ef763-5c1f-4a96-98e9-234fb7d7cb5d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:27.753745 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a242730-2f52-406f-ab69-ec3fc4c60627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:27.754383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a242730-2f52-406f-ab69-ec3fc4c60627 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:27.754661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a242730-2f52-406f-ab69-ec3fc4c60627 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:27.754933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a242730-2f52-406f-ab69-ec3fc4c60627 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:27.756094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a242730-2f52-406f-ab69-ec3fc4c60627 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:27.757711 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a242730-2f52-406f-ab69-ec3fc4c60627 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:27.759363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 78/150] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:27 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:27.765264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806ea55-c0e9-47d4-976a-ae8f8f7d5c06 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:27.791715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:27.878371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806ea55-c0e9-47d4-976a-ae8f8f7d5c06 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:27.925902 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9158ee-73f8-48e7-8719-f21bb490dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:27.926529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9158ee-73f8-48e7-8719-f21bb490dd81 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:27.926808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9158ee-73f8-48e7-8719-f21bb490dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:27.927075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9158ee-73f8-48e7-8719-f21bb490dd81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:27.927847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9158ee-73f8-48e7-8719-f21bb490dd81 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=5f268518677d45a2953a77368e9f5965, user.id=46428667f2c84b109fb9821da86b0938) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:27.928151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9158ee-73f8-48e7-8719-f21bb490dd81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:27.930760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9158ee-73f8-48e7-8719-f21bb490dd81 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:27.943448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 73/151] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:27 2022] GET /identity/v3/role_assignments?user.id=46428667f2c84b109fb9821da86b0938&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:28.031515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a242730-2f52-406f-ab69-ec3fc4c60627 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:28.117304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:28.162947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a242730-2f52-406f-ab69-ec3fc4c60627 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:28.206902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e54cb-a600-4811-95c9-c9be221cb43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:28.207580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e54cb-a600-4811-95c9-c9be221cb43f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:28.207866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e54cb-a600-4811-95c9-c9be221cb43f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:28.208146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e54cb-a600-4811-95c9-c9be221cb43f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:28.225233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e54cb-a600-4811-95c9-c9be221cb43f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-9c7e54cb-a600-4811-95c9-c9be221cb43f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:28.230748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:28.231612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:28.234048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 79/152] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:35:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:28.238080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9158ee-73f8-48e7-8719-f21bb490dd81 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:28.334163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:28.351835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9158ee-73f8-48e7-8719-f21bb490dd81 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:28.398209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d823295-f919-48e5-b2f6-6f59772287c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:28.398838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d823295-f919-48e5-b2f6-6f59772287c8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:28.399117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d823295-f919-48e5-b2f6-6f59772287c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:28.399413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d823295-f919-48e5-b2f6-6f59772287c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:28.400294 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d823295-f919-48e5-b2f6-6f59772287c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:28.400602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d823295-f919-48e5-b2f6-6f59772287c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:28.401997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d823295-f919-48e5-b2f6-6f59772287c8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:28.411457 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 74/153] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:35:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:28.417175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e54cb-a600-4811-95c9-c9be221cb43f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:28.441378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1a3ef-e82d-4b8e-9c07-0861e31304d5 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:28.441825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1a3ef-e82d-4b8e-9c07-0861e31304d5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:28.442241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1a3ef-e82d-4b8e-9c07-0861e31304d5 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:28.443950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 75/154] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:28.453837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27712b-4f0d-481d-9d2f-56748cc33307 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:28.454117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27712b-4f0d-481d-9d2f-56748cc33307 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:28.454374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27712b-4f0d-481d-9d2f-56748cc33307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:28.488419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1d27712b-4f0d-481d-9d2f-56748cc33307 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:28.489629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1d27712b-4f0d-481d-9d2f-56748cc33307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:28.596763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e54cb-a600-4811-95c9-c9be221cb43f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:28.610230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 76/155] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:28.632558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:28.646766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962abf1-778a-4915-849f-bf37722a767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:28.647425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962abf1-778a-4915-849f-bf37722a767e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:28.648324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962abf1-778a-4915-849f-bf37722a767e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:28.648495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962abf1-778a-4915-849f-bf37722a767e None admin] PATH_INFO: `/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:28.651791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962abf1-778a-4915-849f-bf37722a767e None admin] RBAC: Authorizing `identity:get_user(user_id=68a49a46fc8d49ef97ff34e2e36f8ba8)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:28.653274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962abf1-778a-4915-849f-bf37722a767e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:28.655321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 80/156] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:28 2022] GET /identity/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:28.660809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27712b-4f0d-481d-9d2f-56748cc33307 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:28.751074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:28.774941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27712b-4f0d-481d-9d2f-56748cc33307 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:28.812301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b24ff1-3df4-49ff-82e2-37ed604b934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:28.812938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b24ff1-3df4-49ff-82e2-37ed604b934c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:28.813208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b24ff1-3df4-49ff-82e2-37ed604b934c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:28.813480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b24ff1-3df4-49ff-82e2-37ed604b934c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:28.821732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60117716-2c5e-4e58-83f5-7d87c3715e82 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:28.822016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60117716-2c5e-4e58-83f5-7d87c3715e82 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:28.822295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60117716-2c5e-4e58-83f5-7d87c3715e82 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:28.823674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 81/157] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:28.834569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd53ad-2680-4de0-adb6-d2a3f6321f72 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:28.834851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd53ad-2680-4de0-adb6-d2a3f6321f72 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:28.835244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd53ad-2680-4de0-adb6-d2a3f6321f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:28.863979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c8dd53ad-2680-4de0-adb6-d2a3f6321f72 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:28.865108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c8dd53ad-2680-4de0-adb6-d2a3f6321f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:28.956350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b24ff1-3df4-49ff-82e2-37ed604b934c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:28.957844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b24ff1-3df4-49ff-82e2-37ed604b934c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:29.006504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 82/158] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:29.061051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98979f2-8027-4aaf-8810-92870ef6c26d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:29.061712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98979f2-8027-4aaf-8810-92870ef6c26d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:29.061712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98979f2-8027-4aaf-8810-92870ef6c26d None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:29.063074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 83/159] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:29.070130 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e3ebb-d8a1-4b80-bcd1-0dc378aaf746 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:29.070420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e3ebb-d8a1-4b80-bcd1-0dc378aaf746 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:29.070699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e3ebb-d8a1-4b80-bcd1-0dc378aaf746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:29.092898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-bd7e3ebb-d8a1-4b80-bcd1-0dc378aaf746 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:29.095112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bd7e3ebb-d8a1-4b80-bcd1-0dc378aaf746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:29.127719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:29.186049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 77/160] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:29.188951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 84/161] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:29.191757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b24ff1-3df4-49ff-82e2-37ed604b934c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:29.292731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e3ebb-d8a1-4b80-bcd1-0dc378aaf746 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:29.323032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b24ff1-3df4-49ff-82e2-37ed604b934c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:29.380780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b0e05-4753-4406-9d57-2e84922cf7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:29.381651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b0e05-4753-4406-9d57-2e84922cf7bc None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:29.382094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b0e05-4753-4406-9d57-2e84922cf7bc None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:29.382505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b0e05-4753-4406-9d57-2e84922cf7bc None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:29.385492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b0e05-4753-4406-9d57-2e84922cf7bc None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:29.387110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b0e05-4753-4406-9d57-2e84922cf7bc None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:29.388924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 78/162] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:29 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:29.396407 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b0e05-4753-4406-9d57-2e84922cf7bc None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:29.423194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:29.483645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:29.524655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e3ebb-d8a1-4b80-bcd1-0dc378aaf746 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:29.610688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b0e05-4753-4406-9d57-2e84922cf7bc None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:29.615057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad87fe-c67c-49cf-8c01-5a7e7389953d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:29.619775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad87fe-c67c-49cf-8c01-5a7e7389953d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:29.620058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad87fe-c67c-49cf-8c01-5a7e7389953d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:29.620333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad87fe-c67c-49cf-8c01-5a7e7389953d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:29.644713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad87fe-c67c-49cf-8c01-5a7e7389953d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-a0ad87fe-c67c-49cf-8c01-5a7e7389953d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:29.652349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:29.653287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 85/163] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:29.654057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad87fe-c67c-49cf-8c01-5a7e7389953d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:29.684247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc3cad-21af-4432-9cdb-27d5c21ff484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:29.684858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc3cad-21af-4432-9cdb-27d5c21ff484 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:29.685137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc3cad-21af-4432-9cdb-27d5c21ff484 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:29.685408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc3cad-21af-4432-9cdb-27d5c21ff484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:29.686132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc3cad-21af-4432-9cdb-27d5c21ff484 None admin] RBAC: Adding query filter params (role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=5f268518677d45a2953a77368e9f5965, user.id=68a49a46fc8d49ef97ff34e2e36f8ba8) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:29.686439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc3cad-21af-4432-9cdb-27d5c21ff484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:29.687913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc3cad-21af-4432-9cdb-27d5c21ff484 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:29.701386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 79/164] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:29 2022] GET /identity/v3/role_assignments?user.id=68a49a46fc8d49ef97ff34e2e36f8ba8&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:29.702265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc3cad-21af-4432-9cdb-27d5c21ff484 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:29.869947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc3cad-21af-4432-9cdb-27d5c21ff484 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:29.891688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:29.919810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad87fe-c67c-49cf-8c01-5a7e7389953d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:29.937768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:29.943493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028bc97-f925-4722-9cc5-aa187d160c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:29.944147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028bc97-f925-4722-9cc5-aa187d160c1c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:29.945087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028bc97-f925-4722-9cc5-aa187d160c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:29.945255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028bc97-f925-4722-9cc5-aa187d160c1c None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:29.945973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028bc97-f925-4722-9cc5-aa187d160c1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:29.946278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028bc97-f925-4722-9cc5-aa187d160c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:29.948867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028bc97-f925-4722-9cc5-aa187d160c1c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:29.965230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 80/165] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:29.965909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028bc97-f925-4722-9cc5-aa187d160c1c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:29.986559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5a37a-895f-47c3-a25d-49cdec2c4723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:29.987204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5a37a-895f-47c3-a25d-49cdec2c4723 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:29.987504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5a37a-895f-47c3-a25d-49cdec2c4723 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:29.987774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5a37a-895f-47c3-a25d-49cdec2c4723 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.008354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5a37a-895f-47c3-a25d-49cdec2c4723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-c5b5a37a-895f-47c3-a25d-49cdec2c4723 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:30.013184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:30.014035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:30.014884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 86/166] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:30.015722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5a37a-895f-47c3-a25d-49cdec2c4723 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:30.169926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028bc97-f925-4722-9cc5-aa187d160c1c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:30.222180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5a37a-895f-47c3-a25d-49cdec2c4723 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:30.236818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cb72f-6f7b-4a6e-ab7d-b105ffc1145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:30.237467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb72f-6f7b-4a6e-ab7d-b105ffc1145e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.237744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb72f-6f7b-4a6e-ab7d-b105ffc1145e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.238011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb72f-6f7b-4a6e-ab7d-b105ffc1145e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.256227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cb72f-6f7b-4a6e-ab7d-b105ffc1145e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-b35cb72f-6f7b-4a6e-ab7d-b105ffc1145e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:30.265937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:30.266883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:30.267680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 81/167] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:30.268334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cb72f-6f7b-4a6e-ab7d-b105ffc1145e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:30.292962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc961ca8-4766-47fd-bdb5-3dfea08f74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:30.293606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc961ca8-4766-47fd-bdb5-3dfea08f74aa None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.293886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc961ca8-4766-47fd-bdb5-3dfea08f74aa None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.294152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc961ca8-4766-47fd-bdb5-3dfea08f74aa None admin] PATH_INFO: `/v3/users/c29d5993c0074d8d872d0d7063c1e8df` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.295301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc961ca8-4766-47fd-bdb5-3dfea08f74aa None admin] RBAC: Authorizing `identity:get_user(user_id=c29d5993c0074d8d872d0d7063c1e8df)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:30.296750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc961ca8-4766-47fd-bdb5-3dfea08f74aa None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:30.302638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 87/168] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:30 2022] GET /identity/v3/users/c29d5993c0074d8d872d0d7063c1e8df => generated 289 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:30.303485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc961ca8-4766-47fd-bdb5-3dfea08f74aa None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:30.328850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:30.367404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:30.426282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cb72f-6f7b-4a6e-ab7d-b105ffc1145e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:30.444945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc961ca8-4766-47fd-bdb5-3dfea08f74aa None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:30.470637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dabd3-01ac-4da0-93b8-8da69284ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:30.471981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dabd3-01ac-4da0-93b8-8da69284ed2c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.472498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dabd3-01ac-4da0-93b8-8da69284ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.472906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dabd3-01ac-4da0-93b8-8da69284ed2c None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.473856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dabd3-01ac-4da0-93b8-8da69284ed2c None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:30.474574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dabd3-01ac-4da0-93b8-8da69284ed2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:30.476780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dabd3-01ac-4da0-93b8-8da69284ed2c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:30.482155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958e04d-5414-4c6c-af13-95eea069264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:30.482976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e04d-5414-4c6c-af13-95eea069264b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.483427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e04d-5414-4c6c-af13-95eea069264b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.483836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e04d-5414-4c6c-af13-95eea069264b None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.484714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e04d-5414-4c6c-af13-95eea069264b None admin] RBAC: Adding query filter params (name=member) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:30.485156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e04d-5414-4c6c-af13-95eea069264b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:30.486500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 82/169] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:30.486937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e04d-5414-4c6c-af13-95eea069264b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:30.487338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dabd3-01ac-4da0-93b8-8da69284ed2c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:30.497299 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 88/170] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:30.499006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6765ff-8c48-46d8-8cab-f616b00f925a None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.499485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6765ff-8c48-46d8-8cab-f616b00f925a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.499929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6765ff-8c48-46d8-8cab-f616b00f925a None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.505580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 89/171] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:30.506537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6765ff-8c48-46d8-8cab-f616b00f925a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:30.592159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:30.599151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dabd3-01ac-4da0-93b8-8da69284ed2c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:30.619079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6765ff-8c48-46d8-8cab-f616b00f925a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:30.621016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:30.634786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e95ade-ffbd-492a-8ba5-8f73baa93566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:30.635739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e95ade-ffbd-492a-8ba5-8f73baa93566 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.636198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e95ade-ffbd-492a-8ba5-8f73baa93566 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.636621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e95ade-ffbd-492a-8ba5-8f73baa93566 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.637952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e95ade-ffbd-492a-8ba5-8f73baa93566 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:30.639572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e95ade-ffbd-492a-8ba5-8f73baa93566 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:30.641332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 83/172] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:30 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:30.642297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e95ade-ffbd-492a-8ba5-8f73baa93566 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:30.661863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3c5c6-c5f6-4d94-9de7-8de5c2917f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:30.662787 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3c5c6-c5f6-4d94-9de7-8de5c2917f99 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.663336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3c5c6-c5f6-4d94-9de7-8de5c2917f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.663782 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3c5c6-c5f6-4d94-9de7-8de5c2917f99 None admin] PATH_INFO: `/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.665119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3c5c6-c5f6-4d94-9de7-8de5c2917f99 None admin] RBAC: Authorizing `identity:get_user(user_id=68a49a46fc8d49ef97ff34e2e36f8ba8)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:30.666858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3c5c6-c5f6-4d94-9de7-8de5c2917f99 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:30.670088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 90/173] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:30 2022] GET /identity/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:30.671531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de8a6a-05d7-4608-9287-986362f0965f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.671955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de8a6a-05d7-4608-9287-986362f0965f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.672484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de8a6a-05d7-4608-9287-986362f0965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.693583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c6de8a6a-05d7-4608-9287-986362f0965f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:30.695209 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c6de8a6a-05d7-4608-9287-986362f0965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:30.747233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e95ade-ffbd-492a-8ba5-8f73baa93566 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:30.778870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 91/174] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:30.780297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de8a6a-05d7-4608-9287-986362f0965f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:30.782290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc411bc9-3d32-4317-a39f-2468b45fed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:30.782973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc411bc9-3d32-4317-a39f-2468b45fed74 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.783342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc411bc9-3d32-4317-a39f-2468b45fed74 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.783685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc411bc9-3d32-4317-a39f-2468b45fed74 None admin] PATH_INFO: `/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.785216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc411bc9-3d32-4317-a39f-2468b45fed74 None admin] RBAC: Authorizing `identity:get_user(user_id=68a49a46fc8d49ef97ff34e2e36f8ba8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:30.786394 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc411bc9-3d32-4317-a39f-2468b45fed74 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:30.793707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 84/175] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:30 2022] GET /identity/v3/users/68a49a46fc8d49ef97ff34e2e36f8ba8 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:30.794600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc411bc9-3d32-4317-a39f-2468b45fed74 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:30.827070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:30.899997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc411bc9-3d32-4317-a39f-2468b45fed74 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:30.926600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:30.931624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de8a6a-05d7-4608-9287-986362f0965f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:30.947066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd29cc-0996-4279-b8a7-09cae63ee40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:30.948259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd29cc-0996-4279-b8a7-09cae63ee40d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.948736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd29cc-0996-4279-b8a7-09cae63ee40d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.949286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd29cc-0996-4279-b8a7-09cae63ee40d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.968848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f9b1e-5c07-4156-a704-491c56e63285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:30.969636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f9b1e-5c07-4156-a704-491c56e63285 None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:30.970031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f9b1e-5c07-4156-a704-491c56e63285 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:30.970400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f9b1e-5c07-4156-a704-491c56e63285 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965/users/c29d5993c0074d8d872d0d7063c1e8df/roles/eafae458ff434a238f62753799a89414` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:30.972524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f9b1e-5c07-4156-a704-491c56e63285 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f268518677d45a2953a77368e9f5965, user_id=c29d5993c0074d8d872d0d7063c1e8df, role_id=eafae458ff434a238f62753799a89414)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:30.974073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f9b1e-5c07-4156-a704-491c56e63285 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:31.027159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd29cc-0996-4279-b8a7-09cae63ee40d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:31.028658 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd29cc-0996-4279-b8a7-09cae63ee40d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:31.043942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 92/176] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:35:30 2022] PUT /identity/v3/projects/5f268518677d45a2953a77368e9f5965/users/c29d5993c0074d8d872d0d7063c1e8df/roles/eafae458ff434a238f62753799a89414 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:31.045617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f9b1e-5c07-4156-a704-491c56e63285 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:31.063208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:31.163808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 85/177] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:31.165344 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03260f8c-ab3e-4782-8e54-ab484ff0ee82 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.165487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03260f8c-ab3e-4782-8e54-ab484ff0ee82 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.175316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03260f8c-ab3e-4782-8e54-ab484ff0ee82 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.175316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 86/178] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:31.175316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973381a-1c04-4f8f-becc-e62b358c7ea9 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.175316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973381a-1c04-4f8f-becc-e62b358c7ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.175316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973381a-1c04-4f8f-becc-e62b358c7ea9 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.175316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 87/179] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:31.175957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973381a-1c04-4f8f-becc-e62b358c7ea9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:31.176370 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f9b1e-5c07-4156-a704-491c56e63285 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:31.220682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0bec7-2a14-48c4-b689-df4f87ee98ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:31.221223 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0bec7-2a14-48c4-b689-df4f87ee98ec None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.221510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0bec7-2a14-48c4-b689-df4f87ee98ec None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.221771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0bec7-2a14-48c4-b689-df4f87ee98ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.254513 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:31.298046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973381a-1c04-4f8f-becc-e62b358c7ea9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:31.299350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0bec7-2a14-48c4-b689-df4f87ee98ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:31.300885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0bec7-2a14-48c4-b689-df4f87ee98ec None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:31.328640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:31.335678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8c54-a02b-4078-99fd-059d12151ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:31.336724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8c54-a02b-4078-99fd-059d12151ccf None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.336724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8c54-a02b-4078-99fd-059d12151ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.337133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8c54-a02b-4078-99fd-059d12151ccf None admin] PATH_INFO: `/v3/projects/addd8e4a934c47c5b0752e42925db7a7` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.338388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb8c54-a02b-4078-99fd-059d12151ccf None admin] RBAC: Authorizing `identity:get_project(project_id=addd8e4a934c47c5b0752e42925db7a7)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:31.339878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb8c54-a02b-4078-99fd-059d12151ccf None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:31.346109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 88/180] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:31 2022] GET /identity/v3/projects/addd8e4a934c47c5b0752e42925db7a7 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:31.346109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8c54-a02b-4078-99fd-059d12151ccf None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:31.419478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 93/181] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:31.420768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e59ed-008d-434a-82c7-439edc6d061f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.421060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e59ed-008d-434a-82c7-439edc6d061f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.421341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e59ed-008d-434a-82c7-439edc6d061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.439742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-f88e59ed-008d-434a-82c7-439edc6d061f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:31.440939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f88e59ed-008d-434a-82c7-439edc6d061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:31.462443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8c54-a02b-4078-99fd-059d12151ccf None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:31.500114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:31.501076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a442-23c8-431e-b4e1-61990e84b3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:31.501762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a442-23c8-431e-b4e1-61990e84b3f0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.502213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a442-23c8-431e-b4e1-61990e84b3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.502318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a442-23c8-431e-b4e1-61990e84b3f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.511853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 94/182] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:31.515562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e03886-d937-4a82-8fe9-f00f9d08a1f5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.515562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e03886-d937-4a82-8fe9-f00f9d08a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.515562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e03886-d937-4a82-8fe9-f00f9d08a1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.524282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65a442-23c8-431e-b4e1-61990e84b3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-4d65a442-23c8-431e-b4e1-61990e84b3f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:31.531038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:31.531942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:31.532702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:31.534675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 89/183] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:31.539439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-05e03886-d937-4a82-8fe9-f00f9d08a1f5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:31.539439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-05e03886-d937-4a82-8fe9-f00f9d08a1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:31.540570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a442-23c8-431e-b4e1-61990e84b3f0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:31.619989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:31.633197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 95/184] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:31.635064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e03886-d937-4a82-8fe9-f00f9d08a1f5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:31.669182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a442-23c8-431e-b4e1-61990e84b3f0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:31.708630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1121d0c-dd1e-46ce-a4f7-ba61b9374721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:31.709624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1121d0c-dd1e-46ce-a4f7-ba61b9374721 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.710337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1121d0c-dd1e-46ce-a4f7-ba61b9374721 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.710957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1121d0c-dd1e-46ce-a4f7-ba61b9374721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.712021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1121d0c-dd1e-46ce-a4f7-ba61b9374721 None admin] RBAC: Adding query filter params (role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=addd8e4a934c47c5b0752e42925db7a7, user.id=68a49a46fc8d49ef97ff34e2e36f8ba8) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:31.712566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1121d0c-dd1e-46ce-a4f7-ba61b9374721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:31.714334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1121d0c-dd1e-46ce-a4f7-ba61b9374721 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:31.721206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 90/185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:31 2022] GET /identity/v3/role_assignments?user.id=68a49a46fc8d49ef97ff34e2e36f8ba8&scope.project.id=addd8e4a934c47c5b0752e42925db7a7&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:31.722342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1121d0c-dd1e-46ce-a4f7-ba61b9374721 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:31.807784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e03886-d937-4a82-8fe9-f00f9d08a1f5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:31.853814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:31.886956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ddc54-a1b2-426e-b0af-34ebf02ae4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:31.888056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ddc54-a1b2-426e-b0af-34ebf02ae4f2 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.888538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ddc54-a1b2-426e-b0af-34ebf02ae4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.889006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ddc54-a1b2-426e-b0af-34ebf02ae4f2 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.890946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ddc54-a1b2-426e-b0af-34ebf02ae4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:31.893824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ddc54-a1b2-426e-b0af-34ebf02ae4f2 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:31.898190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 96/186] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:31 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:31.899322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ddc54-a1b2-426e-b0af-34ebf02ae4f2 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:31.936743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1121d0c-dd1e-46ce-a4f7-ba61b9374721 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:31.966299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:31.981002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92561bee-ff99-486f-b22b-677d0e2ce3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:31.981643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92561bee-ff99-486f-b22b-677d0e2ce3fd None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:31.981897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92561bee-ff99-486f-b22b-677d0e2ce3fd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:31.982168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92561bee-ff99-486f-b22b-677d0e2ce3fd None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:31.982833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92561bee-ff99-486f-b22b-677d0e2ce3fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:31.983389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92561bee-ff99-486f-b22b-677d0e2ce3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:31.986607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92561bee-ff99-486f-b22b-677d0e2ce3fd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:31.998801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 91/187] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:32.000093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92561bee-ff99-486f-b22b-677d0e2ce3fd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:32.036434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ddc54-a1b2-426e-b0af-34ebf02ae4f2 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:32.076157 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ddeb4-cac0-4b8d-b206-b4fc82dc128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:32.077140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ddeb4-cac0-4b8d-b206-b4fc82dc128c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:32.077521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ddeb4-cac0-4b8d-b206-b4fc82dc128c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:32.077802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ddeb4-cac0-4b8d-b206-b4fc82dc128c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:32.089328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ddeb4-cac0-4b8d-b206-b4fc82dc128c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-dd1ddeb4-cac0-4b8d-b206-b4fc82dc128c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:32.094109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:32.094999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 97/188] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:35:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:32.096732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ddeb4-cac0-4b8d-b206-b4fc82dc128c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:32.113842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92561bee-ff99-486f-b22b-677d0e2ce3fd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:32.149216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:32.150356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123567d-9106-4c1b-b0de-df6e1998bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:32.150965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123567d-9106-4c1b-b0de-df6e1998bf7f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:32.151247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123567d-9106-4c1b-b0de-df6e1998bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:32.151550 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123567d-9106-4c1b-b0de-df6e1998bf7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:32.152275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123567d-9106-4c1b-b0de-df6e1998bf7f None admin] RBAC: Adding query filter params (role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=5f268518677d45a2953a77368e9f5965, user.id=68a49a46fc8d49ef97ff34e2e36f8ba8) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:32.152586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123567d-9106-4c1b-b0de-df6e1998bf7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:32.154032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123567d-9106-4c1b-b0de-df6e1998bf7f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:32.167332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 92/189] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:31 2022] GET /identity/v3/role_assignments?user.id=68a49a46fc8d49ef97ff34e2e36f8ba8&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:32.167332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123567d-9106-4c1b-b0de-df6e1998bf7f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:32.218970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ddeb4-cac0-4b8d-b206-b4fc82dc128c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:32.243667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:32.268243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123c49a-bca2-4f07-8955-6dde2a5f6cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:32.268904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c49a-bca2-4f07-8955-6dde2a5f6cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:32.269171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c49a-bca2-4f07-8955-6dde2a5f6cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:32.269583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c49a-bca2-4f07-8955-6dde2a5f6cd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:32.271139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123c49a-bca2-4f07-8955-6dde2a5f6cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:32.273680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123c49a-bca2-4f07-8955-6dde2a5f6cd3 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:32.276282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 98/190] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:32.277112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123c49a-bca2-4f07-8955-6dde2a5f6cd3 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:32.292934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123567d-9106-4c1b-b0de-df6e1998bf7f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:32.338588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b5a68-f2c3-4096-bf25-ce68abfb291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:32.339196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b5a68-f2c3-4096-bf25-ce68abfb291b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:32.340831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b5a68-f2c3-4096-bf25-ce68abfb291b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:32.341118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b5a68-f2c3-4096-bf25-ce68abfb291b None admin] PATH_INFO: `/v3/users/82a26acd08e64362960226bc56d62ff6` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:32.366485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b5a68-f2c3-4096-bf25-ce68abfb291b None admin] RBAC: Authorizing `identity:get_user(user_id=82a26acd08e64362960226bc56d62ff6)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:32.368144 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b5a68-f2c3-4096-bf25-ce68abfb291b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:32.370874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 93/191] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:32 2022] GET /identity/v3/users/82a26acd08e64362960226bc56d62ff6 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:32.371035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b5a68-f2c3-4096-bf25-ce68abfb291b None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:32.418064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123c49a-bca2-4f07-8955-6dde2a5f6cd3 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:32.438993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:32.458283 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba0be4-d130-4a9c-b0f6-34e22facec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:32.458898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba0be4-d130-4a9c-b0f6-34e22facec1d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:32.459179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba0be4-d130-4a9c-b0f6-34e22facec1d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:32.459484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba0be4-d130-4a9c-b0f6-34e22facec1d None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:32.460630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba0be4-d130-4a9c-b0f6-34e22facec1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:32.461559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba0be4-d130-4a9c-b0f6-34e22facec1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:32.462519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba0be4-d130-4a9c-b0f6-34e22facec1d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:32.471337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 99/192] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:35:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:32.471337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba0be4-d130-4a9c-b0f6-34e22facec1d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:32.495551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b5a68-f2c3-4096-bf25-ce68abfb291b None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:32.504214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:32.532968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb73ce-7bd6-49b4-a04e-d5eff42ebe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:32.533575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb73ce-7bd6-49b4-a04e-d5eff42ebe74 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:32.533895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb73ce-7bd6-49b4-a04e-d5eff42ebe74 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:32.534158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb73ce-7bd6-49b4-a04e-d5eff42ebe74 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:32.534815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb73ce-7bd6-49b4-a04e-d5eff42ebe74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:32.537124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb73ce-7bd6-49b4-a04e-d5eff42ebe74 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:32.582233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba0be4-d130-4a9c-b0f6-34e22facec1d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:32.618196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e6bde-7b10-47ce-9619-013c4949e624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:32.618741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6bde-7b10-47ce-9619-013c4949e624 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:32.619023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6bde-7b10-47ce-9619-013c4949e624 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:32.619313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6bde-7b10-47ce-9619-013c4949e624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:32.639423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 94/193] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:35:32 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:32.640662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb73ce-7bd6-49b4-a04e-d5eff42ebe74 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:32.687040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:32.724683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e6bde-7b10-47ce-9619-013c4949e624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:32.726460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e6bde-7b10-47ce-9619-013c4949e624 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:32.781357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb73ce-7bd6-49b4-a04e-d5eff42ebe74 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:32.825193 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b6e48-c0d6-4740-b00b-6e498e8dcb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:32.826097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b6e48-c0d6-4740-b00b-6e498e8dcb69 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:32.826484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b6e48-c0d6-4740-b00b-6e498e8dcb69 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:32.826861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b6e48-c0d6-4740-b00b-6e498e8dcb69 None admin] PATH_INFO: `/v3/users/82a26acd08e64362960226bc56d62ff6` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:32.828173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b6e48-c0d6-4740-b00b-6e498e8dcb69 None admin] RBAC: Authorizing `identity:get_user(user_id=82a26acd08e64362960226bc56d62ff6)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:32.829721 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b6e48-c0d6-4740-b00b-6e498e8dcb69 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:32.831906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 95/194] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:32 2022] GET /identity/v3/users/82a26acd08e64362960226bc56d62ff6 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:32.837976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b6e48-c0d6-4740-b00b-6e498e8dcb69 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:32.869682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 100/195] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:32.875218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e6bde-7b10-47ce-9619-013c4949e624 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:32.882074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:32.980078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b6e48-c0d6-4740-b00b-6e498e8dcb69 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:32.989381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:33.017015 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e6bde-7b10-47ce-9619-013c4949e624 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:33.025259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d67a5-d926-4a1e-b311-db9e2ca3c74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:33.026847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d67a5-d926-4a1e-b311-db9e2ca3c74b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:33.026847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d67a5-d926-4a1e-b311-db9e2ca3c74b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:33.026847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d67a5-d926-4a1e-b311-db9e2ca3c74b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:33.063451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcff4cb-efbd-420d-8e19-ca9610af7290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:33.065003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcff4cb-efbd-420d-8e19-ca9610af7290 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:33.065458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcff4cb-efbd-420d-8e19-ca9610af7290 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:33.065907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcff4cb-efbd-420d-8e19-ca9610af7290 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:33.067821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcff4cb-efbd-420d-8e19-ca9610af7290 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:33.069869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcff4cb-efbd-420d-8e19-ca9610af7290 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:33.073028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 101/196] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:32 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:33.079434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcff4cb-efbd-420d-8e19-ca9610af7290 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:33.118502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d67a5-d926-4a1e-b311-db9e2ca3c74b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:33.120441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d67a5-d926-4a1e-b311-db9e2ca3c74b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:33.160635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:33.215128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcff4cb-efbd-420d-8e19-ca9610af7290 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:33.259132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca733-75c4-4db7-9897-5b5e41a7b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:33.259774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca733-75c4-4db7-9897-5b5e41a7b543 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:33.260050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca733-75c4-4db7-9897-5b5e41a7b543 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:33.260323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca733-75c4-4db7-9897-5b5e41a7b543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:33.260837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 96/197] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:33.261050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eca733-75c4-4db7-9897-5b5e41a7b543 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab, user.id=82a26acd08e64362960226bc56d62ff6) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:33.261356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eca733-75c4-4db7-9897-5b5e41a7b543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:33.262246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f351-57ad-4b1d-8c25-e0c3670d0a3f None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:33.262537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f351-57ad-4b1d-8c25-e0c3670d0a3f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:33.262822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f351-57ad-4b1d-8c25-e0c3670d0a3f None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:33.262924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eca733-75c4-4db7-9897-5b5e41a7b543 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:33.264311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 97/198] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:33.270216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907b9a-8409-403b-85e2-8eef8c287b9a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:33.270506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907b9a-8409-403b-85e2-8eef8c287b9a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:33.270780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907b9a-8409-403b-85e2-8eef8c287b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:33.274097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 102/199] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:33 2022] GET /identity/v3/role_assignments?user.id=82a26acd08e64362960226bc56d62ff6&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:33.275573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca733-75c4-4db7-9897-5b5e41a7b543 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:33.289991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:33.291278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b7907b9a-8409-403b-85e2-8eef8c287b9a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:33.292530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b7907b9a-8409-403b-85e2-8eef8c287b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:33.393201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 98/200] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:33.419204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca733-75c4-4db7-9897-5b5e41a7b543 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:33.474114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd60cd-104e-457b-9147-20b5ef0954ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:33.474757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd60cd-104e-457b-9147-20b5ef0954ea None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:33.475041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd60cd-104e-457b-9147-20b5ef0954ea None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:33.476903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd60cd-104e-457b-9147-20b5ef0954ea None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:33.478978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd60cd-104e-457b-9147-20b5ef0954ea None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:33.480488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd60cd-104e-457b-9147-20b5ef0954ea None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:33.482307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 103/201] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:33 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:33.488011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907b9a-8409-403b-85e2-8eef8c287b9a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:33.554842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:33.609725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907b9a-8409-403b-85e2-8eef8c287b9a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:33.657927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e8781-b5d1-44e7-9424-9c43679c45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:33.658464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e8781-b5d1-44e7-9424-9c43679c45f0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:33.658743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e8781-b5d1-44e7-9424-9c43679c45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:33.659014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e8781-b5d1-44e7-9424-9c43679c45f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:33.659770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e8781-b5d1-44e7-9424-9c43679c45f0 None admin] RBAC: Adding query filter params (role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab, user.id=82a26acd08e64362960226bc56d62ff6) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:33.660077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e8781-b5d1-44e7-9424-9c43679c45f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:33.661513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e8781-b5d1-44e7-9424-9c43679c45f0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:33.667917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 99/202] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:33 2022] GET /identity/v3/role_assignments?user.id=82a26acd08e64362960226bc56d62ff6&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:33.720657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd60cd-104e-457b-9147-20b5ef0954ea None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:33.839031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:33.864582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd60cd-104e-457b-9147-20b5ef0954ea None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:33.909459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d0e80-0f13-44aa-ac0e-6e269d6228d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:33.910038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d0e80-0f13-44aa-ac0e-6e269d6228d7 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:33.910323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d0e80-0f13-44aa-ac0e-6e269d6228d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:33.910599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d0e80-0f13-44aa-ac0e-6e269d6228d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:33.931783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d0e80-0f13-44aa-ac0e-6e269d6228d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-3a1d0e80-0f13-44aa-ac0e-6e269d6228d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:33.942564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:33.943541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:33.944941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 104/203] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:33.952208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e8781-b5d1-44e7-9424-9c43679c45f0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:34.071153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e8781-b5d1-44e7-9424-9c43679c45f0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:34.095223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:34.106515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208d07-f770-4b4d-813d-0db3495846f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:34.107147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208d07-f770-4b4d-813d-0db3495846f3 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:34.107455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208d07-f770-4b4d-813d-0db3495846f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:34.107731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208d07-f770-4b4d-813d-0db3495846f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:34.108413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208d07-f770-4b4d-813d-0db3495846f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:34.108810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208d07-f770-4b4d-813d-0db3495846f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:34.110239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208d07-f770-4b4d-813d-0db3495846f3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:34.120995 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 100/204] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:34.126478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d0e80-0f13-44aa-ac0e-6e269d6228d7 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:34.232737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d0e80-0f13-44aa-ac0e-6e269d6228d7 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:34.276119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f434dc-d29b-496b-906b-0a904d2fef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:34.276771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f434dc-d29b-496b-906b-0a904d2fef8f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:34.279532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f434dc-d29b-496b-906b-0a904d2fef8f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:34.279899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f434dc-d29b-496b-906b-0a904d2fef8f None admin] PATH_INFO: `/v3/users/c29d5993c0074d8d872d0d7063c1e8df` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:34.281144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f434dc-d29b-496b-906b-0a904d2fef8f None admin] RBAC: Authorizing `identity:get_user(user_id=c29d5993c0074d8d872d0d7063c1e8df)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:34.282618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f434dc-d29b-496b-906b-0a904d2fef8f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:34.284680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 105/205] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:34 2022] GET /identity/v3/users/c29d5993c0074d8d872d0d7063c1e8df => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:34.292503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208d07-f770-4b4d-813d-0db3495846f3 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:34.449865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208d07-f770-4b4d-813d-0db3495846f3 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:34.496357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630766c-4d3b-4d65-8f44-bd31294a1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:34.496927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630766c-4d3b-4d65-8f44-bd31294a1854 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:34.497209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630766c-4d3b-4d65-8f44-bd31294a1854 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:34.497478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630766c-4d3b-4d65-8f44-bd31294a1854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:34.562225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:34.580494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630766c-4d3b-4d65-8f44-bd31294a1854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:34.581967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630766c-4d3b-4d65-8f44-bd31294a1854 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:34.706426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 101/206] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:34.712565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f434dc-d29b-496b-906b-0a904d2fef8f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:34.721424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:34.843337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f434dc-d29b-496b-906b-0a904d2fef8f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:34.891137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c06e7-bfbe-4be6-96c1-2b2f77cdb381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:34.891798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c06e7-bfbe-4be6-96c1-2b2f77cdb381 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:34.892075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c06e7-bfbe-4be6-96c1-2b2f77cdb381 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:34.892345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c06e7-bfbe-4be6-96c1-2b2f77cdb381 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:34.894322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c06e7-bfbe-4be6-96c1-2b2f77cdb381 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:34.895797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c06e7-bfbe-4be6-96c1-2b2f77cdb381 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:34.898018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 106/207] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:34 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:34.903816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630766c-4d3b-4d65-8f44-bd31294a1854 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:35.008380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:35.027520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630766c-4d3b-4d65-8f44-bd31294a1854 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:35.065671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9827388-dd09-43cf-8f80-0cc55629ee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:35.066279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827388-dd09-43cf-8f80-0cc55629ee91 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:35.066554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827388-dd09-43cf-8f80-0cc55629ee91 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:35.066822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9827388-dd09-43cf-8f80-0cc55629ee91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:35.067580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9827388-dd09-43cf-8f80-0cc55629ee91 None admin] RBAC: Adding query filter params (role.id=eafae458ff434a238f62753799a89414, scope.project.id=5f268518677d45a2953a77368e9f5965, user.id=c29d5993c0074d8d872d0d7063c1e8df) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:35.067947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9827388-dd09-43cf-8f80-0cc55629ee91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:35.069761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9827388-dd09-43cf-8f80-0cc55629ee91 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:35.076911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 102/208] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:34 2022] GET /identity/v3/role_assignments?user.id=c29d5993c0074d8d872d0d7063c1e8df&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=eafae458ff434a238f62753799a89414 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:35.185345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6203a94-35fa-4bcf-a4c8-317bb2a9ac24 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:35.185526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6203a94-35fa-4bcf-a4c8-317bb2a9ac24 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:35.185815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6203a94-35fa-4bcf-a4c8-317bb2a9ac24 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:35.187520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 107/209] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:35.193172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2f931-e611-408b-8311-9479ccddb658 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:35.193494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2f931-e611-408b-8311-9479ccddb658 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:35.193850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2f931-e611-408b-8311-9479ccddb658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:35.215273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3eb2f931-e611-408b-8311-9479ccddb658 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:35.216458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3eb2f931-e611-408b-8311-9479ccddb658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:35.308490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 103/210] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:35.509807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39c7b-0af1-4d08-99b3-0bcac1fd128e None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:35.510315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39c7b-0af1-4d08-99b3-0bcac1fd128e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:35.510409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39c7b-0af1-4d08-99b3-0bcac1fd128e None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:35.511745 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 108/211] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:35.517402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153c14-4205-40ac-8e74-d5247af7a0fa None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:35.517865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153c14-4205-40ac-8e74-d5247af7a0fa None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:35.517950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33153c14-4205-40ac-8e74-d5247af7a0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:35.538095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-33153c14-4205-40ac-8e74-d5247af7a0fa None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:35.539666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-33153c14-4205-40ac-8e74-d5247af7a0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:35.604592 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f39c7b-0af1-4d08-99b3-0bcac1fd128e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:35.634963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 104/212] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:35.700024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:35.728812 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f39c7b-0af1-4d08-99b3-0bcac1fd128e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:35.763334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f24630-fb79-4364-9365-10d0dae2c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:35.763893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f24630-fb79-4364-9365-10d0dae2c0cc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:35.764172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f24630-fb79-4364-9365-10d0dae2c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:35.764445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f24630-fb79-4364-9365-10d0dae2c0cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:35.774929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f24630-fb79-4364-9365-10d0dae2c0cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-04f24630-fb79-4364-9365-10d0dae2c0cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:35.779941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:35.780925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:35.781697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 109/213] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:35.787363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33153c14-4205-40ac-8e74-d5247af7a0fa None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:35.800474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:35.892765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33153c14-4205-40ac-8e74-d5247af7a0fa None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:35.928937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ed196-8a84-4e60-b049-2a6654b422f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:35.930044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ed196-8a84-4e60-b049-2a6654b422f6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:35.930331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ed196-8a84-4e60-b049-2a6654b422f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:35.930608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ed196-8a84-4e60-b049-2a6654b422f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:35.931278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ed196-8a84-4e60-b049-2a6654b422f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:35.931607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ed196-8a84-4e60-b049-2a6654b422f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:35.932987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ed196-8a84-4e60-b049-2a6654b422f6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:35.942049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 105/214] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:35.943529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f24630-fb79-4364-9365-10d0dae2c0cc None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:35.948311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ed196-8a84-4e60-b049-2a6654b422f6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:36.036605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:36.057333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f24630-fb79-4364-9365-10d0dae2c0cc None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:36.069880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ed196-8a84-4e60-b049-2a6654b422f6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:36.092260 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c33468-f8ff-4e1d-8b59-91f75729757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:36.092892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c33468-f8ff-4e1d-8b59-91f75729757a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.093178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c33468-f8ff-4e1d-8b59-91f75729757a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.093455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c33468-f8ff-4e1d-8b59-91f75729757a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.094587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c33468-f8ff-4e1d-8b59-91f75729757a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:36.096082 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c33468-f8ff-4e1d-8b59-91f75729757a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:36.099329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 110/215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:36.099329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565b7af-7057-4627-87fd-8f69ff0bf0e0 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.099329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565b7af-7057-4627-87fd-8f69ff0bf0e0 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.099329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565b7af-7057-4627-87fd-8f69ff0bf0e0 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.103428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 111/216] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:36.104526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ae425-7466-45b9-a64b-f697fb1bf0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:36.104763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0221e-d02d-4c72-83e9-fb4614880fd4 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.105035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0221e-d02d-4c72-83e9-fb4614880fd4 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.105223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ae425-7466-45b9-a64b-f697fb1bf0f6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.105502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0221e-d02d-4c72-83e9-fb4614880fd4 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.105601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ae425-7466-45b9-a64b-f697fb1bf0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.105777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ae425-7466-45b9-a64b-f697fb1bf0f6 None admin] PATH_INFO: `/v3/users/8b11967fba8c47bba442dba29f0c485c` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.106733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 112/217] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:36.107443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0221e-d02d-4c72-83e9-fb4614880fd4 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:36.111394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:36.120246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ae425-7466-45b9-a64b-f697fb1bf0f6 None admin] RBAC: Authorizing `identity:get_user(user_id=8b11967fba8c47bba442dba29f0c485c)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:36.122104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ae425-7466-45b9-a64b-f697fb1bf0f6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:36.123852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 106/218] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:35 2022] GET /identity/v3/users/8b11967fba8c47bba442dba29f0c485c => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:36.125305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac03c-a000-42b2-a5e3-3583831ff504 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.125423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac03c-a000-42b2-a5e3-3583831ff504 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.125610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac03c-a000-42b2-a5e3-3583831ff504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.142925 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-358ac03c-a000-42b2-a5e3-3583831ff504 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:36.144139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-358ac03c-a000-42b2-a5e3-3583831ff504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:36.211060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 107/219] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:36.212111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0221e-d02d-4c72-83e9-fb4614880fd4 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:36.212318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d566d-da5d-4878-b1bc-99ac98f37a8a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.212606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d566d-da5d-4878-b1bc-99ac98f37a8a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.212883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d566d-da5d-4878-b1bc-99ac98f37a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.236500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f16d566d-da5d-4878-b1bc-99ac98f37a8a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:36.237671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f16d566d-da5d-4878-b1bc-99ac98f37a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:36.252686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89c96-cc0a-467b-9140-c9b4640ac40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:36.253305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89c96-cc0a-467b-9140-c9b4640ac40a None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.253587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89c96-cc0a-467b-9140-c9b4640ac40a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.253862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89c96-cc0a-467b-9140-c9b4640ac40a None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.254511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac89c96-cc0a-467b-9140-c9b4640ac40a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:36.255995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac89c96-cc0a-467b-9140-c9b4640ac40a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:36.297716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:36.310339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 108/220] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:36.320093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d566d-da5d-4878-b1bc-99ac98f37a8a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:36.378924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 113/221] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:35:36 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:36.441381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d566d-da5d-4878-b1bc-99ac98f37a8a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:36.481501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51b383-0366-43e1-8545-1aa14974d38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:36.482699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51b383-0366-43e1-8545-1aa14974d38c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.482985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51b383-0366-43e1-8545-1aa14974d38c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.483207 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89c96-cc0a-467b-9140-c9b4640ac40a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:36.483335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51b383-0366-43e1-8545-1aa14974d38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.551842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:36.568549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51b383-0366-43e1-8545-1aa14974d38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:36.568750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:36.573602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51b383-0366-43e1-8545-1aa14974d38c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:36.620717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89c96-cc0a-467b-9140-c9b4640ac40a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:36.666131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95db0e-badb-4879-9643-b4d5a5e1236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:36.666804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95db0e-badb-4879-9643-b4d5a5e1236c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.667121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95db0e-badb-4879-9643-b4d5a5e1236c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.667432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95db0e-badb-4879-9643-b4d5a5e1236c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.682040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95db0e-badb-4879-9643-b4d5a5e1236c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-ab95db0e-badb-4879-9643-b4d5a5e1236c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:36.688135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:36.689288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 114/222] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:36.690749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95db0e-badb-4879-9643-b4d5a5e1236c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:36.705428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 109/223] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:36.706289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51b383-0366-43e1-8545-1aa14974d38c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:36.822645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95db0e-badb-4879-9643-b4d5a5e1236c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:36.823579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:36.833428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51b383-0366-43e1-8545-1aa14974d38c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:36.842393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:36.861350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d9628-4d3c-49ea-b8b1-9d6c1cb063d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:36.862048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d9628-4d3c-49ea-b8b1-9d6c1cb063d6 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.862327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d9628-4d3c-49ea-b8b1-9d6c1cb063d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.862601 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d9628-4d3c-49ea-b8b1-9d6c1cb063d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.870711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989c3f7-7d92-45ec-ac7e-5637a8354abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:36.871357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989c3f7-7d92-45ec-ac7e-5637a8354abb None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:36.871646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989c3f7-7d92-45ec-ac7e-5637a8354abb None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:36.872032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989c3f7-7d92-45ec-ac7e-5637a8354abb None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:36.872972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989c3f7-7d92-45ec-ac7e-5637a8354abb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:36.873488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989c3f7-7d92-45ec-ac7e-5637a8354abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:36.874793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d9628-4d3c-49ea-b8b1-9d6c1cb063d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:36.875245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989c3f7-7d92-45ec-ac7e-5637a8354abb None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-438d9628-4d3c-49ea-b8b1-9d6c1cb063d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:36.879624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:36.889514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 115/224] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:35:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:36.890319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d9628-4d3c-49ea-b8b1-9d6c1cb063d6 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:36.891028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 110/225] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:36.891028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989c3f7-7d92-45ec-ac7e-5637a8354abb None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:36.996957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989c3f7-7d92-45ec-ac7e-5637a8354abb None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:36.999402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d9628-4d3c-49ea-b8b1-9d6c1cb063d6 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:37.035051 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dced569-f59e-420f-8f47-05b1d17e5932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:37.035721 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dced569-f59e-420f-8f47-05b1d17e5932 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:37.036009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dced569-f59e-420f-8f47-05b1d17e5932 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:37.036293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dced569-f59e-420f-8f47-05b1d17e5932 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:37.036970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dced569-f59e-420f-8f47-05b1d17e5932 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:37.037082 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264fd25-d934-4e2a-88ef-41b6541b5393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:37.037279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dced569-f59e-420f-8f47-05b1d17e5932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:37.039195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dced569-f59e-420f-8f47-05b1d17e5932 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:37.039638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264fd25-d934-4e2a-88ef-41b6541b5393 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:37.039937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264fd25-d934-4e2a-88ef-41b6541b5393 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:37.040215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264fd25-d934-4e2a-88ef-41b6541b5393 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:37.041389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264fd25-d934-4e2a-88ef-41b6541b5393 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:37.042843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264fd25-d934-4e2a-88ef-41b6541b5393 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:37.044532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 116/226] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:36 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:37.048118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 111/227] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:35:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:37.052332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264fd25-d934-4e2a-88ef-41b6541b5393 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:37.053576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dced569-f59e-420f-8f47-05b1d17e5932 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:37.073243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:37.111920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:37.164605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dced569-f59e-420f-8f47-05b1d17e5932 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:37.172810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264fd25-d934-4e2a-88ef-41b6541b5393 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:37.202325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac7196-e76e-4668-8f66-0260c19bb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:37.203327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac7196-e76e-4668-8f66-0260c19bb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:37.204088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac7196-e76e-4668-8f66-0260c19bb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:37.204441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac7196-e76e-4668-8f66-0260c19bb9a5 None admin] PATH_INFO: `/v3/users/82a26acd08e64362960226bc56d62ff6` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:37.206176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac7196-e76e-4668-8f66-0260c19bb9a5 None admin] RBAC: Authorizing `identity:get_user(user_id=82a26acd08e64362960226bc56d62ff6)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:37.208487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac7196-e76e-4668-8f66-0260c19bb9a5 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:37.210810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 112/228] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:37 2022] GET /identity/v3/users/82a26acd08e64362960226bc56d62ff6 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:37.211801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac7196-e76e-4668-8f66-0260c19bb9a5 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:37.216822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97058c60-a32d-4441-8034-c825d8ab555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:37.217587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97058c60-a32d-4441-8034-c825d8ab555b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:37.217877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97058c60-a32d-4441-8034-c825d8ab555b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:37.218258 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97058c60-a32d-4441-8034-c825d8ab555b None admin] PATH_INFO: `/v3/users/82a26acd08e64362960226bc56d62ff6` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:37.219446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97058c60-a32d-4441-8034-c825d8ab555b None admin] RBAC: Authorizing `identity:get_user(user_id=82a26acd08e64362960226bc56d62ff6)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:37.220974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97058c60-a32d-4441-8034-c825d8ab555b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:37.222568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 117/229] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:37 2022] GET /identity/v3/users/82a26acd08e64362960226bc56d62ff6 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:37.223371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97058c60-a32d-4441-8034-c825d8ab555b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:37.319548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:37.341222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac7196-e76e-4668-8f66-0260c19bb9a5 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:37.346595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97058c60-a32d-4441-8034-c825d8ab555b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:37.362233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:37.379860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd9a2a-b6ae-43e3-912d-91585e2be9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:37.380656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd9a2a-b6ae-43e3-912d-91585e2be9c8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:37.382287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd9a2a-b6ae-43e3-912d-91585e2be9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:37.382287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd9a2a-b6ae-43e3-912d-91585e2be9c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:37.382545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd9a2a-b6ae-43e3-912d-91585e2be9c8 None admin] RBAC: Adding query filter params (role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab, user.id=8b11967fba8c47bba442dba29f0c485c) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:37.382988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd9a2a-b6ae-43e3-912d-91585e2be9c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:37.384850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd9a2a-b6ae-43e3-912d-91585e2be9c8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:37.385937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71916fc1-f861-4fcd-acaf-bc88a849e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:37.386642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916fc1-f861-4fcd-acaf-bc88a849e2cb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:37.387092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916fc1-f861-4fcd-acaf-bc88a849e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:37.387486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916fc1-f861-4fcd-acaf-bc88a849e2cb None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:37.388772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71916fc1-f861-4fcd-acaf-bc88a849e2cb None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:37.390289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71916fc1-f861-4fcd-acaf-bc88a849e2cb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:37.391611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 113/230] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:37 2022] GET /identity/v3/role_assignments?user.id=8b11967fba8c47bba442dba29f0c485c&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:37.392634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd9a2a-b6ae-43e3-912d-91585e2be9c8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:37.396269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 118/231] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:37 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:37.408381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71916fc1-f861-4fcd-acaf-bc88a849e2cb None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:37.549640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71916fc1-f861-4fcd-acaf-bc88a849e2cb None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:37.595513 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ef258-3274-497e-af12-f67fd832e07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:37.596118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ef258-3274-497e-af12-f67fd832e07f None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:37.596118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ef258-3274-497e-af12-f67fd832e07f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:37.596812 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ef258-3274-497e-af12-f67fd832e07f None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/users/82a26acd08e64362960226bc56d62ff6/roles/b1bfc74339e44fc983bfb20cbf2bda25` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:37.599846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ef258-3274-497e-af12-f67fd832e07f None admin] RBAC: Authorizing `identity:create_grant(project_id=d4f53e5afc1d4015a10f92f1b6923fab, user_id=82a26acd08e64362960226bc56d62ff6, role_id=b1bfc74339e44fc983bfb20cbf2bda25)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:37.601619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ef258-3274-497e-af12-f67fd832e07f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:37.633269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd9a2a-b6ae-43e3-912d-91585e2be9c8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:37.670798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19a046-c598-4070-846a-e04b49773800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:37.671792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19a046-c598-4070-846a-e04b49773800 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:37.672295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19a046-c598-4070-846a-e04b49773800 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:37.672744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19a046-c598-4070-846a-e04b49773800 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:37.674068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19a046-c598-4070-846a-e04b49773800 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:37.675733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19a046-c598-4070-846a-e04b49773800 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:37.678106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 114/232] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:37 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:37.684254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19a046-c598-4070-846a-e04b49773800 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:37.708964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 119/233] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:35:37 2022] PUT /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/users/82a26acd08e64362960226bc56d62ff6/roles/b1bfc74339e44fc983bfb20cbf2bda25 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:37.723687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:37.837566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19a046-c598-4070-846a-e04b49773800 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:37.886057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb2b48-3158-4ee3-832f-b09f4e37ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:37.886640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2b48-3158-4ee3-832f-b09f4e37ddb3 None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:37.886920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2b48-3158-4ee3-832f-b09f4e37ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:37.887192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2b48-3158-4ee3-832f-b09f4e37ddb3 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/users/82a26acd08e64362960226bc56d62ff6/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:37.890770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb2b48-3158-4ee3-832f-b09f4e37ddb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4f53e5afc1d4015a10f92f1b6923fab, user_id=82a26acd08e64362960226bc56d62ff6, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:37.892243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb2b48-3158-4ee3-832f-b09f4e37ddb3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:37.995942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 115/234] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:35:37 2022] PUT /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/users/82a26acd08e64362960226bc56d62ff6/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:38.603258 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7adb-7c19-42a0-acef-279370d548ea None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:38.603776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7adb-7c19-42a0-acef-279370d548ea None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:38.603882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa7adb-7c19-42a0-acef-279370d548ea None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:38.605433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 120/235] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:38.621299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c9a2-0aec-4307-9d42-da5efce51755 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:38.621562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c9a2-0aec-4307-9d42-da5efce51755 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:38.621787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c9a2-0aec-4307-9d42-da5efce51755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:38.645059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-9203c9a2-0aec-4307-9d42-da5efce51755 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:38.646269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9203c9a2-0aec-4307-9d42-da5efce51755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:38.729264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faca9c-b14c-4875-a753-c15308c37010 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:38.729579 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faca9c-b14c-4875-a753-c15308c37010 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:38.729818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faca9c-b14c-4875-a753-c15308c37010 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:38.731342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 121/236] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:38.733700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 116/237] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:38.737238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5960-93df-4f93-b119-ed0bb5274008 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:38.737525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5960-93df-4f93-b119-ed0bb5274008 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:38.737805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a5960-93df-4f93-b119-ed0bb5274008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:38.768323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-377a5960-93df-4f93-b119-ed0bb5274008 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:38.769525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-377a5960-93df-4f93-b119-ed0bb5274008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:38.824258 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:38.869920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 122/238] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:39.045669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c9a2-0aec-4307-9d42-da5efce51755 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:39.048893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:39.170973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c9a2-0aec-4307-9d42-da5efce51755 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:39.220882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ab7b-41f3-4a61-9e16-a75af6600330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:39.221576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ab7b-41f3-4a61-9e16-a75af6600330 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:39.221857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ab7b-41f3-4a61-9e16-a75af6600330 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:39.222123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ab7b-41f3-4a61-9e16-a75af6600330 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:39.231505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a5960-93df-4f93-b119-ed0bb5274008 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:39.235511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ab7b-41f3-4a61-9e16-a75af6600330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-2b89ab7b-41f3-4a61-9e16-a75af6600330 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:39.240508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:39.241372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:39.242147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:39.243253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 117/239] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:39.251415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ab7b-41f3-4a61-9e16-a75af6600330 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:39.373243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:39.430095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a5960-93df-4f93-b119-ed0bb5274008 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:39.446972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ab7b-41f3-4a61-9e16-a75af6600330 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:39.496858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f85a-3c94-43eb-848c-267338834df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:39.497505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f85a-3c94-43eb-848c-267338834df8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:39.497785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f85a-3c94-43eb-848c-267338834df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:39.498057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256f85a-3c94-43eb-848c-267338834df8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:39.500324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256f85a-3c94-43eb-848c-267338834df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:39.501769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256f85a-3c94-43eb-848c-267338834df8 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:39.503352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 123/240] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:39.510511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f85a-3c94-43eb-848c-267338834df8 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:39.516779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad2fdc-2d17-4759-a9a4-f01cf0219983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:39.517396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2fdc-2d17-4759-a9a4-f01cf0219983 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:39.517675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2fdc-2d17-4759-a9a4-f01cf0219983 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:39.517947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2fdc-2d17-4759-a9a4-f01cf0219983 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:39.518613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad2fdc-2d17-4759-a9a4-f01cf0219983 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:39.518913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad2fdc-2d17-4759-a9a4-f01cf0219983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:39.520304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad2fdc-2d17-4759-a9a4-f01cf0219983 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:39.536473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 118/241] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:39.544753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad2fdc-2d17-4759-a9a4-f01cf0219983 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:39.598252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:39.706522 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256f85a-3c94-43eb-848c-267338834df8 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:39.745978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad2fdc-2d17-4759-a9a4-f01cf0219983 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:39.759517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9787828-82ea-47b5-82a5-cd9150a4912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:39.760134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9787828-82ea-47b5-82a5-cd9150a4912b None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:39.760411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9787828-82ea-47b5-82a5-cd9150a4912b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:39.760682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9787828-82ea-47b5-82a5-cd9150a4912b None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:39.761329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9787828-82ea-47b5-82a5-cd9150a4912b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:39.762781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9787828-82ea-47b5-82a5-cd9150a4912b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:39.793332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:39.802068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97dd62-bb47-4aab-a0e6-2dfe4ff66a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:39.802699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97dd62-bb47-4aab-a0e6-2dfe4ff66a71 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:39.803626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97dd62-bb47-4aab-a0e6-2dfe4ff66a71 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:39.804700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97dd62-bb47-4aab-a0e6-2dfe4ff66a71 None admin] PATH_INFO: `/v3/users/2dc1d8476dcf4ca092aa8b3e072e0d47` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:39.819022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97dd62-bb47-4aab-a0e6-2dfe4ff66a71 None admin] RBAC: Authorizing `identity:get_user(user_id=2dc1d8476dcf4ca092aa8b3e072e0d47)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:39.820261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97dd62-bb47-4aab-a0e6-2dfe4ff66a71 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:39.826539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 119/242] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:39 2022] GET /identity/v3/users/2dc1d8476dcf4ca092aa8b3e072e0d47 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:39.826539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4a0d-186a-4f4b-90fb-f56211efe85a None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:39.826539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4a0d-186a-4f4b-90fb-f56211efe85a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:39.826539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e4a0d-186a-4f4b-90fb-f56211efe85a None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:39.827362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 120/243] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:39.830454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4a0d-186a-4f4b-90fb-f56211efe85a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:39.857138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 124/244] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:35:39 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:39.858388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4479b-6e11-41b3-8ee5-2a964994c104 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:39.858675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4479b-6e11-41b3-8ee5-2a964994c104 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:39.859096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4479b-6e11-41b3-8ee5-2a964994c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:39.905180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-07b4479b-6e11-41b3-8ee5-2a964994c104 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:39.906389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-07b4479b-6e11-41b3-8ee5-2a964994c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:39.968690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e4a0d-186a-4f4b-90fb-f56211efe85a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:40.051601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fc2a9-56dc-44f2-ab52-d3596671c58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:40.052225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc2a9-56dc-44f2-ab52-d3596671c58e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.052506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc2a9-56dc-44f2-ab52-d3596671c58e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.052857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc2a9-56dc-44f2-ab52-d3596671c58e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.072902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 125/245] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:40.123240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:40.140116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fc2a9-56dc-44f2-ab52-d3596671c58e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:40.141583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fc2a9-56dc-44f2-ab52-d3596671c58e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:40.244949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 121/246] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:35:40.253860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4479b-6e11-41b3-8ee5-2a964994c104 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:40.258722 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc629-ef89-44e7-aad9-d86cc333d0ce None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.259013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc629-ef89-44e7-aad9-d86cc333d0ce None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.259303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc629-ef89-44e7-aad9-d86cc333d0ce None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.260932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 122/247] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:40.266129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f630fe0-1e89-4e3f-8887-5e36e5e09e0d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.266440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f630fe0-1e89-4e3f-8887-5e36e5e09e0d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.266718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f630fe0-1e89-4e3f-8887-5e36e5e09e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.286566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-0f630fe0-1e89-4e3f-8887-5e36e5e09e0d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:40.287831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0f630fe0-1e89-4e3f-8887-5e36e5e09e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:40.297717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:40.368376 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 123/248] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:40.390651 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4479b-6e11-41b3-8ee5-2a964994c104 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:40.395357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f630fe0-1e89-4e3f-8887-5e36e5e09e0d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:40.419182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:40.433493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc87fba-bd2c-4e9c-97f9-34dfd511053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:40.434233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc87fba-bd2c-4e9c-97f9-34dfd511053b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.434510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc87fba-bd2c-4e9c-97f9-34dfd511053b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.439262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc87fba-bd2c-4e9c-97f9-34dfd511053b None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.439262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc87fba-bd2c-4e9c-97f9-34dfd511053b None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:40.439262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc87fba-bd2c-4e9c-97f9-34dfd511053b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:40.439494 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 126/249] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:40 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:40.449875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc87fba-bd2c-4e9c-97f9-34dfd511053b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:40.536476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f630fe0-1e89-4e3f-8887-5e36e5e09e0d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:40.572074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:40.580577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc87fba-bd2c-4e9c-97f9-34dfd511053b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:40.582717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12e1af-2e64-4af7-9fc6-5d673b290155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:40.583474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12e1af-2e64-4af7-9fc6-5d673b290155 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.583759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12e1af-2e64-4af7-9fc6-5d673b290155 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.584626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12e1af-2e64-4af7-9fc6-5d673b290155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.600375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12e1af-2e64-4af7-9fc6-5d673b290155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-0f12e1af-2e64-4af7-9fc6-5d673b290155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:40.605091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:40.606030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:40.606793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 124/250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:40.612157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3ab3-ac38-4d38-9c53-23b41f94b60a None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.612454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3ab3-ac38-4d38-9c53-23b41f94b60a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.612753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3ab3-ac38-4d38-9c53-23b41f94b60a None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.618505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 125/251] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:40.620328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c5067-e923-427d-a759-05716c8eef9b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.620610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c5067-e923-427d-a759-05716c8eef9b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.620884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c5067-e923-427d-a759-05716c8eef9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.629863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe439926-298b-44a3-9657-979620e0e5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:40.629863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439926-298b-44a3-9657-979620e0e5c0 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.630085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439926-298b-44a3-9657-979620e0e5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.630318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439926-298b-44a3-9657-979620e0e5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.631142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe439926-298b-44a3-9657-979620e0e5c0 None admin] RBAC: Adding query filter params (role.id=eafae458ff434a238f62753799a89414, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab, user.id=2dc1d8476dcf4ca092aa8b3e072e0d47) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:40.631622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe439926-298b-44a3-9657-979620e0e5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:40.633105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe439926-298b-44a3-9657-979620e0e5c0 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:40.638823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 127/252] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:40 2022] GET /identity/v3/role_assignments?user.id=2dc1d8476dcf4ca092aa8b3e072e0d47&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=eafae458ff434a238f62753799a89414 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:40.639597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-fe2c5067-e923-427d-a759-05716c8eef9b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:40.639775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe439926-298b-44a3-9657-979620e0e5c0 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:40.641332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fe2c5067-e923-427d-a759-05716c8eef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:40.759812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 126/253] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:40.760743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c5067-e923-427d-a759-05716c8eef9b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:40.773092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:40.829573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe439926-298b-44a3-9657-979620e0e5c0 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:40.910987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c5067-e923-427d-a759-05716c8eef9b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:40.951325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae0014-6b51-4844-90c5-e3bac35857bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:40.952694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae0014-6b51-4844-90c5-e3bac35857bd None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.953191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae0014-6b51-4844-90c5-e3bac35857bd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.953678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae0014-6b51-4844-90c5-e3bac35857bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.964016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f14b3-0bfa-4808-b97d-a4e7a4f42756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:40.969456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f14b3-0bfa-4808-b97d-a4e7a4f42756 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:40.969456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f14b3-0bfa-4808-b97d-a4e7a4f42756 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:40.969456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f14b3-0bfa-4808-b97d-a4e7a4f42756 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:40.969456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f14b3-0bfa-4808-b97d-a4e7a4f42756 None admin] RBAC: Adding query filter params (name=member) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:40.969456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f14b3-0bfa-4808-b97d-a4e7a4f42756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:40.969456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f14b3-0bfa-4808-b97d-a4e7a4f42756 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:40.978495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae0014-6b51-4844-90c5-e3bac35857bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:40.982151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 128/254] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-a4ae0014-6b51-4844-90c5-e3bac35857bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:40.983478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:40.984325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:40.985109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 127/255] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:35:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:40.987606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f14b3-0bfa-4808-b97d-a4e7a4f42756 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:40.991600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae0014-6b51-4844-90c5-e3bac35857bd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:41.027972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:41.118980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f14b3-0bfa-4808-b97d-a4e7a4f42756 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:41.132310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:41.167789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427a473-96a8-45fa-8948-96e35639155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:41.168431 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a473-96a8-45fa-8948-96e35639155a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:41.168710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a473-96a8-45fa-8948-96e35639155a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:41.168976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a473-96a8-45fa-8948-96e35639155a None admin] PATH_INFO: `/v3/users/8b11967fba8c47bba442dba29f0c485c` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:41.171545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427a473-96a8-45fa-8948-96e35639155a None admin] RBAC: Authorizing `identity:get_user(user_id=8b11967fba8c47bba442dba29f0c485c)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:41.172992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427a473-96a8-45fa-8948-96e35639155a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:41.174896 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 129/256] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:40 2022] GET /identity/v3/users/8b11967fba8c47bba442dba29f0c485c => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:41.181338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427a473-96a8-45fa-8948-96e35639155a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:41.223549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae0014-6b51-4844-90c5-e3bac35857bd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:41.276131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b528f7-d960-42f9-8ec4-cf855e1fa11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:41.276745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b528f7-d960-42f9-8ec4-cf855e1fa11a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:41.277028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b528f7-d960-42f9-8ec4-cf855e1fa11a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:41.277305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b528f7-d960-42f9-8ec4-cf855e1fa11a None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:41.278034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b528f7-d960-42f9-8ec4-cf855e1fa11a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:41.278339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b528f7-d960-42f9-8ec4-cf855e1fa11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:41.279794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b528f7-d960-42f9-8ec4-cf855e1fa11a None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:41.282626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:41.288597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 128/257] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:35:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:41.299103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427a473-96a8-45fa-8948-96e35639155a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:41.307337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b528f7-d960-42f9-8ec4-cf855e1fa11a None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:41.346572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a2b7-36b8-457a-96e3-c8341b628a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:41.347201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a2b7-36b8-457a-96e3-c8341b628a7a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:41.347629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a2b7-36b8-457a-96e3-c8341b628a7a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:41.347908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a2b7-36b8-457a-96e3-c8341b628a7a None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:41.349025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66a2b7-36b8-457a-96e3-c8341b628a7a None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:41.350705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66a2b7-36b8-457a-96e3-c8341b628a7a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:41.352685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 130/258] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:41 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:41.353743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a2b7-36b8-457a-96e3-c8341b628a7a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:41.483027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a2b7-36b8-457a-96e3-c8341b628a7a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:41.519858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5592dd-808e-4d96-9ff9-84cf784bf5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:41.520848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5592dd-808e-4d96-9ff9-84cf784bf5a0 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:41.521620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5592dd-808e-4d96-9ff9-84cf784bf5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:41.522098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5592dd-808e-4d96-9ff9-84cf784bf5a0 None admin] PATH_INFO: `/v3/users/82a26acd08e64362960226bc56d62ff6` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:41.523545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5592dd-808e-4d96-9ff9-84cf784bf5a0 None admin] RBAC: Authorizing `identity:get_user(user_id=82a26acd08e64362960226bc56d62ff6)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:41.525268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5592dd-808e-4d96-9ff9-84cf784bf5a0 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:41.527083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 131/259] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:41 2022] GET /identity/v3/users/82a26acd08e64362960226bc56d62ff6 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:41.528165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5592dd-808e-4d96-9ff9-84cf784bf5a0 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:41.551442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b528f7-d960-42f9-8ec4-cf855e1fa11a None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:41.567742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:41.616840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:41.636881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5592dd-808e-4d96-9ff9-84cf784bf5a0 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:41.660550 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e7325-92e9-4cb3-b055-e5e119fe386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:41.661773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e7325-92e9-4cb3-b055-e5e119fe386a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:41.663805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e7325-92e9-4cb3-b055-e5e119fe386a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:41.665462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e7325-92e9-4cb3-b055-e5e119fe386a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:41.684666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e7325-92e9-4cb3-b055-e5e119fe386a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:41.692911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92972e53-631c-4448-a85c-800e3bda3d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:41.694643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92972e53-631c-4448-a85c-800e3bda3d65 None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:41.695142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92972e53-631c-4448-a85c-800e3bda3d65 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:41.695709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92972e53-631c-4448-a85c-800e3bda3d65 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/users/8b11967fba8c47bba442dba29f0c485c/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:41.698056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92972e53-631c-4448-a85c-800e3bda3d65 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4f53e5afc1d4015a10f92f1b6923fab, user_id=8b11967fba8c47bba442dba29f0c485c, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-242e7325-92e9-4cb3-b055-e5e119fe386a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:41.699195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:41.700099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:41.700878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:41.705301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92972e53-631c-4448-a85c-800e3bda3d65 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:41.710582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 129/260] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:41.714313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e7325-92e9-4cb3-b055-e5e119fe386a None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:41.817805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 132/261] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:35:41 2022] PUT /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/users/8b11967fba8c47bba442dba29f0c485c/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:41.818388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92972e53-631c-4448-a85c-800e3bda3d65 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:41.822352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e7325-92e9-4cb3-b055-e5e119fe386a None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:41.860421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ca2a-b0a8-458e-a500-971136369cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:41.861043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ca2a-b0a8-458e-a500-971136369cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:41.861383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ca2a-b0a8-458e-a500-971136369cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:41.861658 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8ca2a-b0a8-458e-a500-971136369cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:41.924136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:41.937509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8ca2a-b0a8-458e-a500-971136369cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:41.939081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8ca2a-b0a8-458e-a500-971136369cc4 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:42.048213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:42.048727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 130/262] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:42.055909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ca2a-b0a8-458e-a500-971136369cc4 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:42.070968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92972e53-631c-4448-a85c-800e3bda3d65 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:42.150414 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cbfe3-9891-4992-92b2-c206d4a9c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:42.151037 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cbfe3-9891-4992-92b2-c206d4a9c16c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:42.151360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cbfe3-9891-4992-92b2-c206d4a9c16c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:42.151637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cbfe3-9891-4992-92b2-c206d4a9c16c None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:42.152318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cbfe3-9891-4992-92b2-c206d4a9c16c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:42.152622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cbfe3-9891-4992-92b2-c206d4a9c16c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:42.154010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cbfe3-9891-4992-92b2-c206d4a9c16c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:42.171043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 133/263] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:42.176471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cbfe3-9891-4992-92b2-c206d4a9c16c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:42.220553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:42.244749 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8ca2a-b0a8-458e-a500-971136369cc4 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:42.316206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb7b97-69c5-4e23-8334-d6926d36ffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:42.316892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb7b97-69c5-4e23-8334-d6926d36ffb5 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:42.317341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb7b97-69c5-4e23-8334-d6926d36ffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:42.317617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb7b97-69c5-4e23-8334-d6926d36ffb5 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:42.319966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb7b97-69c5-4e23-8334-d6926d36ffb5 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:42.325531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb7b97-69c5-4e23-8334-d6926d36ffb5 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:42.331400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 131/264] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:42 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:42.337464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb7b97-69c5-4e23-8334-d6926d36ffb5 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:42.409207 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cbfe3-9891-4992-92b2-c206d4a9c16c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:42.464817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb7b97-69c5-4e23-8334-d6926d36ffb5 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:42.495986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7d90d-fa44-4b76-9760-18b8cc1ebb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:42.496631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d90d-fa44-4b76-9760-18b8cc1ebb21 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:42.496950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d90d-fa44-4b76-9760-18b8cc1ebb21 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:42.498006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d90d-fa44-4b76-9760-18b8cc1ebb21 None admin] PATH_INFO: `/v3/users/82a26acd08e64362960226bc56d62ff6` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:42.499168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7d90d-fa44-4b76-9760-18b8cc1ebb21 None admin] RBAC: Authorizing `identity:get_user(user_id=82a26acd08e64362960226bc56d62ff6)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:42.500828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7d90d-fa44-4b76-9760-18b8cc1ebb21 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:42.502700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 134/265] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:42 2022] GET /identity/v3/users/82a26acd08e64362960226bc56d62ff6 => generated 283 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:42.507217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42948bd2-8b6a-4849-9110-5fa6ac930bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:42.508178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948bd2-8b6a-4849-9110-5fa6ac930bcf None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:42.508576 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7d90d-fa44-4b76-9760-18b8cc1ebb21 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:42.508862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948bd2-8b6a-4849-9110-5fa6ac930bcf None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:42.509340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948bd2-8b6a-4849-9110-5fa6ac930bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:42.510269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42948bd2-8b6a-4849-9110-5fa6ac930bcf None admin] RBAC: Adding query filter params (role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab, user.id=82a26acd08e64362960226bc56d62ff6) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:42.510769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42948bd2-8b6a-4849-9110-5fa6ac930bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:42.512528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42948bd2-8b6a-4849-9110-5fa6ac930bcf None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:42.520057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 132/266] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:42 2022] GET /identity/v3/role_assignments?user.id=82a26acd08e64362960226bc56d62ff6&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:42.545239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:42.666829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7d90d-fa44-4b76-9760-18b8cc1ebb21 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:42.716303 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b77a89-88e0-4c0e-9b12-e39d91ffa63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:42.716920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b77a89-88e0-4c0e-9b12-e39d91ffa63c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:42.717201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b77a89-88e0-4c0e-9b12-e39d91ffa63c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:42.717469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b77a89-88e0-4c0e-9b12-e39d91ffa63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:42.815521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b77a89-88e0-4c0e-9b12-e39d91ffa63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:42.816995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b77a89-88e0-4c0e-9b12-e39d91ffa63c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:42.839259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:42.877113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6d1e4-653f-49c2-a7b1-656782ad72c8 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:42.877664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6d1e4-653f-49c2-a7b1-656782ad72c8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:42.877664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6d1e4-653f-49c2-a7b1-656782ad72c8 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:42.879264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 133/267] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:42.893053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f6b9f-625f-4b2f-8c1c-ef23f9ddc7f8 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:42.893373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f6b9f-625f-4b2f-8c1c-ef23f9ddc7f8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:42.893611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f6b9f-625f-4b2f-8c1c-ef23f9ddc7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:42.931410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8b5f6b9f-625f-4b2f-8c1c-ef23f9ddc7f8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:42.932593 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8b5f6b9f-625f-4b2f-8c1c-ef23f9ddc7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:42.960136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:42.998397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 135/268] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:35:43.003695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b77a89-88e0-4c0e-9b12-e39d91ffa63c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:43.023726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 134/269] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:43.104978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9697-c192-4bcd-9859-91d1a276fa4e None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:43.105292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9697-c192-4bcd-9859-91d1a276fa4e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:43.105523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db9697-c192-4bcd-9859-91d1a276fa4e None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:43.106865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 135/270] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:43.113383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5c50-0b5b-4fb6-9f4a-1f307625af25 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:43.113665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5c50-0b5b-4fb6-9f4a-1f307625af25 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:43.113939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5c50-0b5b-4fb6-9f4a-1f307625af25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:43.128786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b77a89-88e0-4c0e-9b12-e39d91ffa63c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:43.144346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-9a5b5c50-0b5b-4fb6-9f4a-1f307625af25 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:43.144907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:43.145712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9a5b5c50-0b5b-4fb6-9f4a-1f307625af25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:43.167929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b304d-993c-4a7d-a970-3435bf4c3789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:43.168983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b304d-993c-4a7d-a970-3435bf4c3789 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:43.169455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b304d-993c-4a7d-a970-3435bf4c3789 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:43.169935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b304d-993c-4a7d-a970-3435bf4c3789 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:43.171417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b304d-993c-4a7d-a970-3435bf4c3789 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:43.173104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b304d-993c-4a7d-a970-3435bf4c3789 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:43.175301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 136/271] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:43 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:43.182686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b304d-993c-4a7d-a970-3435bf4c3789 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:43.258211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 136/272] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:43.330571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b304d-993c-4a7d-a970-3435bf4c3789 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:43.388491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39804579-0e4b-4995-befe-d53cec18783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:43.389427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39804579-0e4b-4995-befe-d53cec18783b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:43.389899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39804579-0e4b-4995-befe-d53cec18783b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:43.390433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39804579-0e4b-4995-befe-d53cec18783b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:43.391372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39804579-0e4b-4995-befe-d53cec18783b None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab, user.id=82a26acd08e64362960226bc56d62ff6) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:43.391961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39804579-0e4b-4995-befe-d53cec18783b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:43.392824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5c50-0b5b-4fb6-9f4a-1f307625af25 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:43.393806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39804579-0e4b-4995-befe-d53cec18783b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:43.404223 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 137/273] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:43 2022] GET /identity/v3/role_assignments?user.id=82a26acd08e64362960226bc56d62ff6&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:43.478789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cb0f-82fb-481d-a240-649aca2ca848 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:43.479413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cb0f-82fb-481d-a240-649aca2ca848 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:43.480122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:43.481140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cb0f-82fb-481d-a240-649aca2ca848 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:43.483143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 138/274] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:43.488856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae22bb7-bd57-4aad-a624-4a02fc6f7f00 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:43.489999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae22bb7-bd57-4aad-a624-4a02fc6f7f00 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:43.490783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae22bb7-bd57-4aad-a624-4a02fc6f7f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:43.527782 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-aae22bb7-bd57-4aad-a624-4a02fc6f7f00 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:43.530118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-aae22bb7-bd57-4aad-a624-4a02fc6f7f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:43.534971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5c50-0b5b-4fb6-9f4a-1f307625af25 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:43.604206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededb3e6-9535-49f7-8ee2-64f0de5e24b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:43.604206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededb3e6-9535-49f7-8ee2-64f0de5e24b2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:43.604206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededb3e6-9535-49f7-8ee2-64f0de5e24b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:43.604206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededb3e6-9535-49f7-8ee2-64f0de5e24b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:43.609921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:43.625244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededb3e6-9535-49f7-8ee2-64f0de5e24b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-ededb3e6-9535-49f7-8ee2-64f0de5e24b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:43.630440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:43.632168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:43.632928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:43.633509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 137/275] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:43.638873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededb3e6-9535-49f7-8ee2-64f0de5e24b2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:43.642789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 139/276] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:43.651002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae22bb7-bd57-4aad-a624-4a02fc6f7f00 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:43.785052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae22bb7-bd57-4aad-a624-4a02fc6f7f00 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:43.785667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededb3e6-9535-49f7-8ee2-64f0de5e24b2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:43.826968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c4fa7-5e52-4166-8908-275f83df18e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:43.828018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c4fa7-5e52-4166-8908-275f83df18e3 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:43.828538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c4fa7-5e52-4166-8908-275f83df18e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:43.829001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c4fa7-5e52-4166-8908-275f83df18e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:43.830388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440868e-673f-44fd-90d2-85b9b973a7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:43.830997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440868e-673f-44fd-90d2-85b9b973a7cd None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:43.831318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440868e-673f-44fd-90d2-85b9b973a7cd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:43.831837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440868e-673f-44fd-90d2-85b9b973a7cd None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:43.832513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440868e-673f-44fd-90d2-85b9b973a7cd None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:43.833567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440868e-673f-44fd-90d2-85b9b973a7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:43.834685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440868e-673f-44fd-90d2-85b9b973a7cd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:43.841164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:43.844252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c4fa7-5e52-4166-8908-275f83df18e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:43.845939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 138/277] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-7e8c4fa7-5e52-4166-8908-275f83df18e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:43.852038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:43.858225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:43.859010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 140/278] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:43.859692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440868e-673f-44fd-90d2-85b9b973a7cd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:43.859760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c4fa7-5e52-4166-8908-275f83df18e3 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:43.903141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:43.978395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440868e-673f-44fd-90d2-85b9b973a7cd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:43.989408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c4fa7-5e52-4166-8908-275f83df18e3 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:44.018657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958513a-dd2a-438c-8bd0-d8eae00c3703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:44.019402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958513a-dd2a-438c-8bd0-d8eae00c3703 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.019682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958513a-dd2a-438c-8bd0-d8eae00c3703 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.020008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958513a-dd2a-438c-8bd0-d8eae00c3703 None admin] PATH_INFO: `/v3/users/8de17da8276742309684bf8d2c495a8d` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.027058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8577043-a45b-413f-bd5e-86ff4f2ee119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:44.027700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8577043-a45b-413f-bd5e-86ff4f2ee119 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.027984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8577043-a45b-413f-bd5e-86ff4f2ee119 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.028381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8577043-a45b-413f-bd5e-86ff4f2ee119 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.029060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8577043-a45b-413f-bd5e-86ff4f2ee119 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:44.029371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8577043-a45b-413f-bd5e-86ff4f2ee119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:44.030789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8577043-a45b-413f-bd5e-86ff4f2ee119 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:44.034444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958513a-dd2a-438c-8bd0-d8eae00c3703 None admin] RBAC: Authorizing `identity:get_user(user_id=8de17da8276742309684bf8d2c495a8d)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:44.036142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958513a-dd2a-438c-8bd0-d8eae00c3703 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:44.038828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 139/279] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:43 2022] GET /identity/v3/users/8de17da8276742309684bf8d2c495a8d => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:44.039817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958513a-dd2a-438c-8bd0-d8eae00c3703 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:44.040125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 141/280] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:44.044550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8577043-a45b-413f-bd5e-86ff4f2ee119 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:44.105980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:44.147875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:44.150762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958513a-dd2a-438c-8bd0-d8eae00c3703 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:44.151447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8577043-a45b-413f-bd5e-86ff4f2ee119 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:44.188398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0fc06-da98-4990-8df1-ff121160da09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:44.188601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1f543-bf4b-4ff1-8578-ca58d26a43b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:44.189130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1f543-bf4b-4ff1-8578-ca58d26a43b7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.189421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1f543-bf4b-4ff1-8578-ca58d26a43b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.189655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0fc06-da98-4990-8df1-ff121160da09 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.189761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1f543-bf4b-4ff1-8578-ca58d26a43b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.190154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0fc06-da98-4990-8df1-ff121160da09 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.190552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0fc06-da98-4990-8df1-ff121160da09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.190788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1f543-bf4b-4ff1-8578-ca58d26a43b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:44.191598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0fc06-da98-4990-8df1-ff121160da09 None admin] RBAC: Adding query filter params (role.id=2b1ba082ef764b35bc85187a263a9016, user.id=8de17da8276742309684bf8d2c495a8d, scope.system=all) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:44.192040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0fc06-da98-4990-8df1-ff121160da09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:44.192271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1f543-bf4b-4ff1-8578-ca58d26a43b7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:44.193869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0fc06-da98-4990-8df1-ff121160da09 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:44.198817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 140/281] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:44.199847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1f543-bf4b-4ff1-8578-ca58d26a43b7 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:44.199994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 142/282] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 24 07:35:44 2022] GET /identity/v3/role_assignments?user.id=8de17da8276742309684bf8d2c495a8d&scope.system=all&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:44.200893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0fc06-da98-4990-8df1-ff121160da09 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:44.342677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0fc06-da98-4990-8df1-ff121160da09 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:44.370021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1f543-bf4b-4ff1-8578-ca58d26a43b7 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:44.392994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692a008-9685-40e1-9f03-73891b0e3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:44.394549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a008-9685-40e1-9f03-73891b0e3371 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.395333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a008-9685-40e1-9f03-73891b0e3371 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.395812 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a008-9685-40e1-9f03-73891b0e3371 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.398040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692a008-9685-40e1-9f03-73891b0e3371 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:44.400400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692a008-9685-40e1-9f03-73891b0e3371 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:44.400882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:44.410490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9165-94b6-43ed-9126-8cc2c3aa1124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:44.411497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9165-94b6-43ed-9126-8cc2c3aa1124 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.419623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9165-94b6-43ed-9126-8cc2c3aa1124 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.419623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9165-94b6-43ed-9126-8cc2c3aa1124 None admin] PATH_INFO: `/v3/users/2dc1d8476dcf4ca092aa8b3e072e0d47` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.419623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f9165-94b6-43ed-9126-8cc2c3aa1124 None admin] RBAC: Authorizing `identity:get_user(user_id=2dc1d8476dcf4ca092aa8b3e072e0d47)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:44.419623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f9165-94b6-43ed-9126-8cc2c3aa1124 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:44.419623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 141/283] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:44 2022] GET /identity/v3/users/2dc1d8476dcf4ca092aa8b3e072e0d47 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:44.423078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9165-94b6-43ed-9126-8cc2c3aa1124 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:44.523540 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 143/284] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:35:44 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:44.539975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9165-94b6-43ed-9126-8cc2c3aa1124 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:44.581516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed73f2b-d0d0-445d-ac48-19a835c2ba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:44.582590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73f2b-d0d0-445d-ac48-19a835c2ba1b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.583116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73f2b-d0d0-445d-ac48-19a835c2ba1b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.583662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73f2b-d0d0-445d-ac48-19a835c2ba1b None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.585598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed73f2b-d0d0-445d-ac48-19a835c2ba1b None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:44.587316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed73f2b-d0d0-445d-ac48-19a835c2ba1b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:44.589626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 142/285] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:44 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:44.595997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692a008-9685-40e1-9f03-73891b0e3371 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:44.620327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:44.648231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64159687-8950-4999-b87e-daee1c814f33 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.648644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64159687-8950-4999-b87e-daee1c814f33 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.648644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64159687-8950-4999-b87e-daee1c814f33 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.650470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 143/286] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:44.655975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1543-aafc-4da2-ab5f-c6aae812776b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.656260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1543-aafc-4da2-ab5f-c6aae812776b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.656526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1543-aafc-4da2-ab5f-c6aae812776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.676498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d0af1543-aafc-4da2-ab5f-c6aae812776b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:44.677755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d0af1543-aafc-4da2-ab5f-c6aae812776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:44.720875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692a008-9685-40e1-9f03-73891b0e3371 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:44.750471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:44.762979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 144/287] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:44.768078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dccfd-3cf9-4c6b-8ab1-df2a9464fca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:44.769060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dccfd-3cf9-4c6b-8ab1-df2a9464fca9 None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:44.769563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dccfd-3cf9-4c6b-8ab1-df2a9464fca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:44.770037 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dccfd-3cf9-4c6b-8ab1-df2a9464fca9 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/users/2dc1d8476dcf4ca092aa8b3e072e0d47/roles/eafae458ff434a238f62753799a89414` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:44.772430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dccfd-3cf9-4c6b-8ab1-df2a9464fca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4f53e5afc1d4015a10f92f1b6923fab, user_id=2dc1d8476dcf4ca092aa8b3e072e0d47, role_id=eafae458ff434a238f62753799a89414)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:44.774217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dccfd-3cf9-4c6b-8ab1-df2a9464fca9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:44.849611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 144/288] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:35:44 2022] PUT /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/users/2dc1d8476dcf4ca092aa8b3e072e0d47/roles/eafae458ff434a238f62753799a89414 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:45.048536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1543-aafc-4da2-ab5f-c6aae812776b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:45.154418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1543-aafc-4da2-ab5f-c6aae812776b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:45.198063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835a1e9-7ba0-42c6-a037-a2ce7557db80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:45.198713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835a1e9-7ba0-42c6-a037-a2ce7557db80 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:45.199001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835a1e9-7ba0-42c6-a037-a2ce7557db80 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:45.199274 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835a1e9-7ba0-42c6-a037-a2ce7557db80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:45.216802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835a1e9-7ba0-42c6-a037-a2ce7557db80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-e835a1e9-7ba0-42c6-a037-a2ce7557db80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:45.221564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:45.222422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:45.223176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 145/289] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:45.229493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dccfd-3cf9-4c6b-8ab1-df2a9464fca9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:45.338645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:45.377334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dccfd-3cf9-4c6b-8ab1-df2a9464fca9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:45.425905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aaf0ea-15e1-4ff5-b309-6d2ec02827a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:45.426438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaf0ea-15e1-4ff5-b309-6d2ec02827a3 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:45.426718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaf0ea-15e1-4ff5-b309-6d2ec02827a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:45.426990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaf0ea-15e1-4ff5-b309-6d2ec02827a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:45.427779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaf0ea-15e1-4ff5-b309-6d2ec02827a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:45.428086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaf0ea-15e1-4ff5-b309-6d2ec02827a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:45.429714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaf0ea-15e1-4ff5-b309-6d2ec02827a3 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:45.440533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 145/290] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:45.446581 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835a1e9-7ba0-42c6-a037-a2ce7557db80 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:45.510802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:45.570278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835a1e9-7ba0-42c6-a037-a2ce7557db80 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:45.610687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2435-db8f-4957-8b05-91bf71f72c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:45.611709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2435-db8f-4957-8b05-91bf71f72c82 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:45.612195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2435-db8f-4957-8b05-91bf71f72c82 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:45.612666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e2435-db8f-4957-8b05-91bf71f72c82 None admin] PATH_INFO: `/v3/users/8b11967fba8c47bba442dba29f0c485c` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:45.613997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e2435-db8f-4957-8b05-91bf71f72c82 None admin] RBAC: Authorizing `identity:get_user(user_id=8b11967fba8c47bba442dba29f0c485c)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:45.616494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e2435-db8f-4957-8b05-91bf71f72c82 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:45.618332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 146/291] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:45 2022] GET /identity/v3/users/8b11967fba8c47bba442dba29f0c485c => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:45.624379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aaf0ea-15e1-4ff5-b309-6d2ec02827a3 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:45.778820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aaf0ea-15e1-4ff5-b309-6d2ec02827a3 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:45.813681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd22a0-8300-4ee7-96d4-ad837cb073cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:45.814284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd22a0-8300-4ee7-96d4-ad837cb073cb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:45.814563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd22a0-8300-4ee7-96d4-ad837cb073cb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:45.814839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd22a0-8300-4ee7-96d4-ad837cb073cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:45.825532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:45.883775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd22a0-8300-4ee7-96d4-ad837cb073cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:45.885256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd22a0-8300-4ee7-96d4-ad837cb073cb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:46.021725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 146/292] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:46.027561 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2435-db8f-4957-8b05-91bf71f72c82 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:46.166248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e2435-db8f-4957-8b05-91bf71f72c82 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:46.186777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:46.207950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31ec7b-a0b9-4a81-b3fc-3dc9648e5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:46.208661 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31ec7b-a0b9-4a81-b3fc-3dc9648e5756 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:46.208947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31ec7b-a0b9-4a81-b3fc-3dc9648e5756 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:46.209222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31ec7b-a0b9-4a81-b3fc-3dc9648e5756 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:46.210385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31ec7b-a0b9-4a81-b3fc-3dc9648e5756 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:46.211868 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31ec7b-a0b9-4a81-b3fc-3dc9648e5756 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:46.218979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 147/293] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:46 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:46.219380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd22a0-8300-4ee7-96d4-ad837cb073cb None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:46.270510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964d5cd-ce32-4542-9892-cd3700142087 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:46.270812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964d5cd-ce32-4542-9892-cd3700142087 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:46.271523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964d5cd-ce32-4542-9892-cd3700142087 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:46.273175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 148/294] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:46.287606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:46.289443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5d00-f769-467a-91d2-97f21103a492 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:46.289742 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5d00-f769-467a-91d2-97f21103a492 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:46.290028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5d00-f769-467a-91d2-97f21103a492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:46.319404 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-94fe5d00-f769-467a-91d2-97f21103a492 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:46.320607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-94fe5d00-f769-467a-91d2-97f21103a492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:46.390467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd22a0-8300-4ee7-96d4-ad837cb073cb None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:46.434831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 149/295] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:46.470714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bd11b-35c3-4908-bd11-8f26158f248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:46.471379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd11b-35c3-4908-bd11-8f26158f248a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:46.471634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd11b-35c3-4908-bd11-8f26158f248a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:46.471906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd11b-35c3-4908-bd11-8f26158f248a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:46.472996 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bd11b-35c3-4908-bd11-8f26158f248a None admin] RBAC: Adding query filter params (role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab, user.id=8b11967fba8c47bba442dba29f0c485c) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:46.473300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bd11b-35c3-4908-bd11-8f26158f248a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:46.475771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bd11b-35c3-4908-bd11-8f26158f248a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:46.487733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 147/296] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:46 2022] GET /identity/v3/role_assignments?user.id=8b11967fba8c47bba442dba29f0c485c&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:46.879539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe5d00-f769-467a-91d2-97f21103a492 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:46.990028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe5d00-f769-467a-91d2-97f21103a492 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:47.011175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:47.033582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fe5d1-2f7a-4cd2-ba2c-76c5278ebaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:47.033887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984812a7-62b1-4fb0-93cc-31e4b5f8ccbd None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.034139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984812a7-62b1-4fb0-93cc-31e4b5f8ccbd None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.037215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fe5d1-2f7a-4cd2-ba2c-76c5278ebaac None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.037350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984812a7-62b1-4fb0-93cc-31e4b5f8ccbd None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.037445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fe5d1-2f7a-4cd2-ba2c-76c5278ebaac None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.037445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fe5d1-2f7a-4cd2-ba2c-76c5278ebaac None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.037567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 148/297] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:47.042435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735999f-b2ab-4aa0-a9c1-ea6887767571 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.042717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735999f-b2ab-4aa0-a9c1-ea6887767571 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.042972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735999f-b2ab-4aa0-a9c1-ea6887767571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.047176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fe5d1-2f7a-4cd2-ba2c-76c5278ebaac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-c54fe5d1-2f7a-4cd2-ba2c-76c5278ebaac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:47.052031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:47.053080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:47.054100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 150/298] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:47.065578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fe5d1-2f7a-4cd2-ba2c-76c5278ebaac None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:47.079246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c735999f-b2ab-4aa0-a9c1-ea6887767571 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:47.080604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c735999f-b2ab-4aa0-a9c1-ea6887767571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:47.153365 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 149/299] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:47.154917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553932-7855-4812-a559-7e32d0c70aea None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.155440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553932-7855-4812-a559-7e32d0c70aea None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.155947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553932-7855-4812-a559-7e32d0c70aea None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.157361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 150/300] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:47.169150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29190cbd-2106-4fae-8689-b1a50928eef0 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.170396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29190cbd-2106-4fae-8689-b1a50928eef0 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.171017 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29190cbd-2106-4fae-8689-b1a50928eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.183143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fe5d1-2f7a-4cd2-ba2c-76c5278ebaac None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:47.196522 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-29190cbd-2106-4fae-8689-b1a50928eef0 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:47.197959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-29190cbd-2106-4fae-8689-b1a50928eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:47.229122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2f30c-3e6d-4bed-9d4b-006766886f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:47.230084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2f30c-3e6d-4bed-9d4b-006766886f56 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.230574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2f30c-3e6d-4bed-9d4b-006766886f56 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.231031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2f30c-3e6d-4bed-9d4b-006766886f56 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.231916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2f30c-3e6d-4bed-9d4b-006766886f56 None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:47.232453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2f30c-3e6d-4bed-9d4b-006766886f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:47.234101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2f30c-3e6d-4bed-9d4b-006766886f56 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:47.237397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:47.244223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 151/301] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:47.249886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2f30c-3e6d-4bed-9d4b-006766886f56 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:47.290004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 151/302] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:47.316639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:47.390559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2f30c-3e6d-4bed-9d4b-006766886f56 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:47.428669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89986-bda8-43ad-92bd-fb16c314b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:47.429882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89986-bda8-43ad-92bd-fb16c314b91e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.430361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89986-bda8-43ad-92bd-fb16c314b91e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.430829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89986-bda8-43ad-92bd-fb16c314b91e None admin] PATH_INFO: `/v3/users/8de17da8276742309684bf8d2c495a8d` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.432734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d89986-bda8-43ad-92bd-fb16c314b91e None admin] RBAC: Authorizing `identity:get_user(user_id=8de17da8276742309684bf8d2c495a8d)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:47.435449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d89986-bda8-43ad-92bd-fb16c314b91e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:47.437281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29190cbd-2106-4fae-8689-b1a50928eef0 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:47.437706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 152/303] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:47 2022] GET /identity/v3/users/8de17da8276742309684bf8d2c495a8d => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:47.443428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89986-bda8-43ad-92bd-fb16c314b91e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:47.550487 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29190cbd-2106-4fae-8689-b1a50928eef0 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:47.553320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89986-bda8-43ad-92bd-fb16c314b91e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:47.564160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:47.587231 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551139f-41b5-4b5b-bddf-a3690919cf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:47.587902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551139f-41b5-4b5b-bddf-a3690919cf42 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.588184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551139f-41b5-4b5b-bddf-a3690919cf42 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.588456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551139f-41b5-4b5b-bddf-a3690919cf42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.588974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4075051-8aa7-4077-aa02-04808d74291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:47.589555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551139f-41b5-4b5b-bddf-a3690919cf42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:47.589654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4075051-8aa7-4077-aa02-04808d74291f None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.589863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4075051-8aa7-4077-aa02-04808d74291f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.590137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4075051-8aa7-4077-aa02-04808d74291f None admin] PATH_INFO: `/v3/system/users/8de17da8276742309684bf8d2c495a8d/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.590992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551139f-41b5-4b5b-bddf-a3690919cf42 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:47.591581 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4075051-8aa7-4077-aa02-04808d74291f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8de17da8276742309684bf8d2c495a8d, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:47.595345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 152/304] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:47.595502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4075051-8aa7-4077-aa02-04808d74291f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:47.595581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b82b6-efeb-441d-a701-4b4170c55a9c None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.595581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b82b6-efeb-441d-a701-4b4170c55a9c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.595581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b82b6-efeb-441d-a701-4b4170c55a9c None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.595581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 153/305] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:47.597905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b82b6-efeb-441d-a701-4b4170c55a9c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:47.629193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:47.667646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 153/306] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Aug 24 07:35:47 2022] PUT /identity/v3/system/users/8de17da8276742309684bf8d2c495a8d/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:35:47.668516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4075051-8aa7-4077-aa02-04808d74291f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:47.706467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b82b6-efeb-441d-a701-4b4170c55a9c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:47.749777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45723ed-e0cb-4951-b323-9deee7b3e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:47.750593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45723ed-e0cb-4951-b323-9deee7b3e694 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.750868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45723ed-e0cb-4951-b323-9deee7b3e694 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.751166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45723ed-e0cb-4951-b323-9deee7b3e694 None admin] PATH_INFO: `/v3/groups` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.751793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45723ed-e0cb-4951-b323-9deee7b3e694 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:47.753341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45723ed-e0cb-4951-b323-9deee7b3e694 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:47.786089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4075051-8aa7-4077-aa02-04808d74291f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:47.822611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 154/307] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Aug 24 07:35:47 2022] POST /identity/v3/groups => generated 229 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:35:47.823492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39560e-1555-4fba-8dbe-fc5b0261aea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:47.824300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7285bc-a8b4-49cf-ba3b-f6cd50f18d9c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.824430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39560e-1555-4fba-8dbe-fc5b0261aea6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:47.824507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7285bc-a8b4-49cf-ba3b-f6cd50f18d9c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.824576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39560e-1555-4fba-8dbe-fc5b0261aea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:47.824641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7285bc-a8b4-49cf-ba3b-f6cd50f18d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.824706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39560e-1555-4fba-8dbe-fc5b0261aea6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:47.837598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39560e-1555-4fba-8dbe-fc5b0261aea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-ca39560e-1555-4fba-8dbe-fc5b0261aea6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:47.844113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:47.845130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:47.845907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 154/308] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:47.848451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ec7285bc-a8b4-49cf-ba3b-f6cd50f18d9c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:47.849800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ec7285bc-a8b4-49cf-ba3b-f6cd50f18d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:47.851968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39560e-1555-4fba-8dbe-fc5b0261aea6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:47.901222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:47.949801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 155/309] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:47.984392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39560e-1555-4fba-8dbe-fc5b0261aea6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:48.021759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95240a91-5adb-4118-b9fb-00112157c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:48.022046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95240a91-5adb-4118-b9fb-00112157c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:48.022302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95240a91-5adb-4118-b9fb-00112157c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:48.022578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95240a91-5adb-4118-b9fb-00112157c3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:48.023251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95240a91-5adb-4118-b9fb-00112157c3e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:48.023634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95240a91-5adb-4118-b9fb-00112157c3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:48.025011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95240a91-5adb-4118-b9fb-00112157c3e9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:48.034273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 155/310] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:48.040683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7285bc-a8b4-49cf-ba3b-f6cd50f18d9c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:48.069196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:48.149372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7285bc-a8b4-49cf-ba3b-f6cd50f18d9c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:48.186637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7949340-b5d5-4702-8acd-619deff50e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:48.187699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7949340-b5d5-4702-8acd-619deff50e57 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:48.188182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7949340-b5d5-4702-8acd-619deff50e57 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:48.188654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7949340-b5d5-4702-8acd-619deff50e57 None admin] PATH_INFO: `/v3/users/aedd00e5898a485b89756ead1e01d80b` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:48.203218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7949340-b5d5-4702-8acd-619deff50e57 None admin] RBAC: Authorizing `identity:get_user(user_id=aedd00e5898a485b89756ead1e01d80b)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:48.205063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7949340-b5d5-4702-8acd-619deff50e57 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:48.206982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 156/311] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:48 2022] GET /identity/v3/users/aedd00e5898a485b89756ead1e01d80b => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:48.213417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95240a91-5adb-4118-b9fb-00112157c3e9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:48.230683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7949340-b5d5-4702-8acd-619deff50e57 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:48.317131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:48.323147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:48.325311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95240a91-5adb-4118-b9fb-00112157c3e9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:48.342780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7949340-b5d5-4702-8acd-619deff50e57 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:48.367311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735b0ea-7abe-4ddc-81f5-bf5696549d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:48.367311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735b0ea-7abe-4ddc-81f5-bf5696549d14 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:48.367311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735b0ea-7abe-4ddc-81f5-bf5696549d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:48.367311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735b0ea-7abe-4ddc-81f5-bf5696549d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:48.367720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735b0ea-7abe-4ddc-81f5-bf5696549d14 None admin] RBAC: Adding query filter params (role.id=eafae458ff434a238f62753799a89414, user.id=aedd00e5898a485b89756ead1e01d80b, scope.system=all) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:48.368035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735b0ea-7abe-4ddc-81f5-bf5696549d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:48.369603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735b0ea-7abe-4ddc-81f5-bf5696549d14 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:48.374988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 156/312] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 24 07:35:48 2022] GET /identity/v3/role_assignments?user.id=aedd00e5898a485b89756ead1e01d80b&scope.system=all&role.id=eafae458ff434a238f62753799a89414 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:48.379331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5f2b-5891-4ded-8213-38886e78e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:48.380000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5f2b-5891-4ded-8213-38886e78e675 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:48.380311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5f2b-5891-4ded-8213-38886e78e675 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:48.380590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5f2b-5891-4ded-8213-38886e78e675 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:48.393207 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb5f2b-5891-4ded-8213-38886e78e675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-aeeb5f2b-5891-4ded-8213-38886e78e675 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:48.398556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:48.399548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:48.400342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 157/313] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:48.408603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735b0ea-7abe-4ddc-81f5-bf5696549d14 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:48.524490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735b0ea-7abe-4ddc-81f5-bf5696549d14 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:48.566070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10414ee1-d286-43c6-89c8-7ea4a345ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:48.566977 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10414ee1-d286-43c6-89c8-7ea4a345ade2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:48.567523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10414ee1-d286-43c6-89c8-7ea4a345ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:48.568511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10414ee1-d286-43c6-89c8-7ea4a345ade2 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:48.569466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10414ee1-d286-43c6-89c8-7ea4a345ade2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:48.569945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10414ee1-d286-43c6-89c8-7ea4a345ade2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:48.571529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10414ee1-d286-43c6-89c8-7ea4a345ade2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:48.580239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 157/314] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:48.586158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5f2b-5891-4ded-8213-38886e78e675 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:48.691627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5f2b-5891-4ded-8213-38886e78e675 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:48.727488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8d212-7833-4bb9-9741-b2b3f51aa5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:48.728406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8d212-7833-4bb9-9741-b2b3f51aa5d8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:48.728938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8d212-7833-4bb9-9741-b2b3f51aa5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:48.729391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8d212-7833-4bb9-9741-b2b3f51aa5d8 None admin] PATH_INFO: `/v3/users/2dc1d8476dcf4ca092aa8b3e072e0d47` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:48.730735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8d212-7833-4bb9-9741-b2b3f51aa5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=2dc1d8476dcf4ca092aa8b3e072e0d47)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:48.732410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8d212-7833-4bb9-9741-b2b3f51aa5d8 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:48.734511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 158/315] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:48 2022] GET /identity/v3/users/2dc1d8476dcf4ca092aa8b3e072e0d47 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:48.740171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10414ee1-d286-43c6-89c8-7ea4a345ade2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:48.763078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:48.846967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10414ee1-d286-43c6-89c8-7ea4a345ade2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:48.885772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594d0d9-5bd1-4f0e-9e41-614d08e598a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:48.886677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594d0d9-5bd1-4f0e-9e41-614d08e598a4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:48.887134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594d0d9-5bd1-4f0e-9e41-614d08e598a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:48.887624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594d0d9-5bd1-4f0e-9e41-614d08e598a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:48.964159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594d0d9-5bd1-4f0e-9e41-614d08e598a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:48.965680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594d0d9-5bd1-4f0e-9e41-614d08e598a4 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:48.987709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:49.078826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 158/316] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:49.085355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8d212-7833-4bb9-9741-b2b3f51aa5d8 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:49.104039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:49.196785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8d212-7833-4bb9-9741-b2b3f51aa5d8 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:49.232368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9258a-208a-485f-900e-b53b5f2be968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:49.233311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9258a-208a-485f-900e-b53b5f2be968 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:49.233815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9258a-208a-485f-900e-b53b5f2be968 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:49.234291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9258a-208a-485f-900e-b53b5f2be968 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:49.235659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9258a-208a-485f-900e-b53b5f2be968 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:49.237309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9258a-208a-485f-900e-b53b5f2be968 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:49.239700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 159/317] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:49 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:49.247279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594d0d9-5bd1-4f0e-9e41-614d08e598a4 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:49.368179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594d0d9-5bd1-4f0e-9e41-614d08e598a4 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:49.388960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:49.407416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fc2f7-ea48-4313-bc7a-77ec5edf8841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:49.408031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc2f7-ea48-4313-bc7a-77ec5edf8841 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:49.408316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc2f7-ea48-4313-bc7a-77ec5edf8841 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:49.408596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc2f7-ea48-4313-bc7a-77ec5edf8841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:49.409391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fc2f7-ea48-4313-bc7a-77ec5edf8841 None admin] RBAC: Adding query filter params (role.id=eafae458ff434a238f62753799a89414, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab, user.id=2dc1d8476dcf4ca092aa8b3e072e0d47) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:49.409700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fc2f7-ea48-4313-bc7a-77ec5edf8841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:49.411157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fc2f7-ea48-4313-bc7a-77ec5edf8841 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:49.418732 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 159/318] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:35:49 2022] GET /identity/v3/role_assignments?user.id=2dc1d8476dcf4ca092aa8b3e072e0d47&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=eafae458ff434a238f62753799a89414 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:49.838607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfeacf-51d7-46a4-b610-245985428c83 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:49.839146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfeacf-51d7-46a4-b610-245985428c83 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:49.839146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfeacf-51d7-46a4-b610-245985428c83 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:49.840675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 160/319] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:49.845607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e16dba-15fa-4918-aeba-72ddd8ade5bb None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:49.845898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e16dba-15fa-4918-aeba-72ddd8ade5bb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:49.846169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e16dba-15fa-4918-aeba-72ddd8ade5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:49.866247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-84e16dba-15fa-4918-aeba-72ddd8ade5bb None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:49.867441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-84e16dba-15fa-4918-aeba-72ddd8ade5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:49.919797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dba8e-43bb-4c41-a3ec-4df5f6172651 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:49.920087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dba8e-43bb-4c41-a3ec-4df5f6172651 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:49.923530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dba8e-43bb-4c41-a3ec-4df5f6172651 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:49.923530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 161/320] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:49.926453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede0741-0eae-468d-bb6c-01ca4c8d3d83 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:49.926740 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede0741-0eae-468d-bb6c-01ca4c8d3d83 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:49.927611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede0741-0eae-468d-bb6c-01ca4c8d3d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:49.939454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 160/321] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:49.949007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-eede0741-0eae-468d-bb6c-01ca4c8d3d83 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:49.950200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-eede0741-0eae-468d-bb6c-01ca4c8d3d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:50.058424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 162/322] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:50.212593 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e16dba-15fa-4918-aeba-72ddd8ade5bb None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:50.308445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e16dba-15fa-4918-aeba-72ddd8ade5bb None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:50.322805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:50.331102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede0741-0eae-468d-bb6c-01ca4c8d3d83 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:50.345296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:50.353074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5bc82-5953-4f2f-a9cf-913304dab3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:50.353720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5bc82-5953-4f2f-a9cf-913304dab3a1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:50.354091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5bc82-5953-4f2f-a9cf-913304dab3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:50.356905 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5bc82-5953-4f2f-a9cf-913304dab3a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:50.366912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5bc82-5953-4f2f-a9cf-913304dab3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-64e5bc82-5953-4f2f-a9cf-913304dab3a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:50.371833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:50.372706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:50.373470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 161/323] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:50.378752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5bc82-5953-4f2f-a9cf-913304dab3a1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:50.447843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede0741-0eae-468d-bb6c-01ca4c8d3d83 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:50.482055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5bc82-5953-4f2f-a9cf-913304dab3a1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:50.483104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7094d38-a1ef-420f-9107-1f19ad355d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:50.484027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7094d38-a1ef-420f-9107-1f19ad355d8c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:50.484480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7094d38-a1ef-420f-9107-1f19ad355d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:50.485732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7094d38-a1ef-420f-9107-1f19ad355d8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:50.486867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7094d38-a1ef-420f-9107-1f19ad355d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:50.488351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7094d38-a1ef-420f-9107-1f19ad355d8c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:50.490267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 163/324] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:50.491309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ae18-5ec8-48b9-bcb3-c67add910a73 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:50.491597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ae18-5ec8-48b9-bcb3-c67add910a73 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:50.491873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ae18-5ec8-48b9-bcb3-c67add910a73 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:50.493084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 164/325] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:50.495910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64ae18-5ec8-48b9-bcb3-c67add910a73 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:50.521355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c62245-9611-44d7-a97a-2caa22fcc23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:50.521969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c62245-9611-44d7-a97a-2caa22fcc23b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:50.522242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c62245-9611-44d7-a97a-2caa22fcc23b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:50.522509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c62245-9611-44d7-a97a-2caa22fcc23b None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:50.523168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c62245-9611-44d7-a97a-2caa22fcc23b None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:50.523501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c62245-9611-44d7-a97a-2caa22fcc23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:50.524871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c62245-9611-44d7-a97a-2caa22fcc23b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:50.532757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 162/326] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:50.536629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32946f-64df-48bf-bc9b-b0bba07fcc46 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:50.536917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32946f-64df-48bf-bc9b-b0bba07fcc46 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:50.537208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32946f-64df-48bf-bc9b-b0bba07fcc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:50.554222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-cf32946f-64df-48bf-bc9b-b0bba07fcc46 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:50.555454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cf32946f-64df-48bf-bc9b-b0bba07fcc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:50.576242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:50.586596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:50.602561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64ae18-5ec8-48b9-bcb3-c67add910a73 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:50.624345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 163/327] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:50.625169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32946f-64df-48bf-bc9b-b0bba07fcc46 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:50.637976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad111e-0d6c-4667-9f6c-e40b05a0b95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:50.638583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad111e-0d6c-4667-9f6c-e40b05a0b95c None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:50.638862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad111e-0d6c-4667-9f6c-e40b05a0b95c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:50.639136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad111e-0d6c-4667-9f6c-e40b05a0b95c None admin] PATH_INFO: `/v3/groups` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:50.639784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad111e-0d6c-4667-9f6c-e40b05a0b95c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:50.641243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad111e-0d6c-4667-9f6c-e40b05a0b95c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:50.735157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32946f-64df-48bf-bc9b-b0bba07fcc46 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:50.742424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 165/328] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Aug 24 07:35:50 2022] POST /identity/v3/groups => generated 226 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:35:50.778832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af674e9-271c-4042-b869-7bbbe8dadc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:50.779718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af674e9-271c-4042-b869-7bbbe8dadc15 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:50.780124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af674e9-271c-4042-b869-7bbbe8dadc15 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:50.780541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af674e9-271c-4042-b869-7bbbe8dadc15 None admin] PATH_INFO: `/v3/users/8de17da8276742309684bf8d2c495a8d` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:50.781909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af674e9-271c-4042-b869-7bbbe8dadc15 None admin] RBAC: Authorizing `identity:get_user(user_id=8de17da8276742309684bf8d2c495a8d)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:50.783565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af674e9-271c-4042-b869-7bbbe8dadc15 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:50.785425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 164/329] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:50 2022] GET /identity/v3/users/8de17da8276742309684bf8d2c495a8d => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:50.792198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad111e-0d6c-4667-9f6c-e40b05a0b95c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:50.893092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af674e9-271c-4042-b869-7bbbe8dadc15 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:50.903813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad111e-0d6c-4667-9f6c-e40b05a0b95c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:50.934680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:50.940468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32079a0f-f185-4113-8a89-56a156d1967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:50.941515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079a0f-f185-4113-8a89-56a156d1967f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:50.942229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079a0f-f185-4113-8a89-56a156d1967f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:50.942229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079a0f-f185-4113-8a89-56a156d1967f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:50.942939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32079a0f-f185-4113-8a89-56a156d1967f None admin] RBAC: Adding query filter params (role.id=2b1ba082ef764b35bc85187a263a9016, user.id=8de17da8276742309684bf8d2c495a8d, scope.system=all) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:50.943242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32079a0f-f185-4113-8a89-56a156d1967f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:50.944706 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32079a0f-f185-4113-8a89-56a156d1967f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:50.946377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:50.957909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 166/330] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 24 07:35:50 2022] GET /identity/v3/role_assignments?user.id=8de17da8276742309684bf8d2c495a8d&scope.system=all&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:51.016205 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af674e9-271c-4042-b869-7bbbe8dadc15 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:51.060282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26368-03c9-4cda-9bff-e13a7c4679b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:51.060935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26368-03c9-4cda-9bff-e13a7c4679b7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:51.061222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26368-03c9-4cda-9bff-e13a7c4679b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:51.061506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26368-03c9-4cda-9bff-e13a7c4679b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:51.074541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f26368-03c9-4cda-9bff-e13a7c4679b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-49f26368-03c9-4cda-9bff-e13a7c4679b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:51.079623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:51.080591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:51.081551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 165/331] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:51.089586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32079a0f-f185-4113-8a89-56a156d1967f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:51.206078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32079a0f-f185-4113-8a89-56a156d1967f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:51.247709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19fd11-3bb8-4468-96ad-460fe56bca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:51.248327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19fd11-3bb8-4468-96ad-460fe56bca61 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:51.248605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19fd11-3bb8-4468-96ad-460fe56bca61 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:51.248889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19fd11-3bb8-4468-96ad-460fe56bca61 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:51.249560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19fd11-3bb8-4468-96ad-460fe56bca61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:51.249863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19fd11-3bb8-4468-96ad-460fe56bca61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:51.251245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19fd11-3bb8-4468-96ad-460fe56bca61 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:51.261343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 167/332] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:51.266966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26368-03c9-4cda-9bff-e13a7c4679b7 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:51.373783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:51.382256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26368-03c9-4cda-9bff-e13a7c4679b7 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:51.418164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493b028-6c11-4fcb-992b-9fd853e9a5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:51.418805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493b028-6c11-4fcb-992b-9fd853e9a5d7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:51.419088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493b028-6c11-4fcb-992b-9fd853e9a5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:51.419399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493b028-6c11-4fcb-992b-9fd853e9a5d7 None admin] PATH_INFO: `/v3/users/aedd00e5898a485b89756ead1e01d80b` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:51.420652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493b028-6c11-4fcb-992b-9fd853e9a5d7 None admin] RBAC: Authorizing `identity:get_user(user_id=aedd00e5898a485b89756ead1e01d80b)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:51.422169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493b028-6c11-4fcb-992b-9fd853e9a5d7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:51.424085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 166/333] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:51 2022] GET /identity/v3/users/aedd00e5898a485b89756ead1e01d80b => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:51.429866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19fd11-3bb8-4468-96ad-460fe56bca61 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:51.501937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:51.550615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19fd11-3bb8-4468-96ad-460fe56bca61 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:51.586662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d3ff9-ff5e-498a-8e9f-79bd3f1cbed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:51.587598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d3ff9-ff5e-498a-8e9f-79bd3f1cbed8 None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:51.588045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d3ff9-ff5e-498a-8e9f-79bd3f1cbed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:51.588461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d3ff9-ff5e-498a-8e9f-79bd3f1cbed8 None admin] PATH_INFO: `/v3/system/users/aedd00e5898a485b89756ead1e01d80b/roles/eafae458ff434a238f62753799a89414` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:51.590093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d3ff9-ff5e-498a-8e9f-79bd3f1cbed8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aedd00e5898a485b89756ead1e01d80b, role_id=eafae458ff434a238f62753799a89414)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:51.591638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d3ff9-ff5e-498a-8e9f-79bd3f1cbed8 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:51.667503 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 168/334] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Aug 24 07:35:51 2022] PUT /identity/v3/system/users/aedd00e5898a485b89756ead1e01d80b/roles/eafae458ff434a238f62753799a89414 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:35:52.949682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb9580-0d19-4726-8842-441b1ed0cc06 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:52.950194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb9580-0d19-4726-8842-441b1ed0cc06 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:52.950268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb9580-0d19-4726-8842-441b1ed0cc06 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:52.952007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 167/335] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:52.957748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eae3a4-c5e6-43ca-b040-f86636f6e5d8 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:52.958419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eae3a4-c5e6-43ca-b040-f86636f6e5d8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:52.958705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eae3a4-c5e6-43ca-b040-f86636f6e5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:52.980788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-25eae3a4-c5e6-43ca-b040-f86636f6e5d8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:52.981983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-25eae3a4-c5e6-43ca-b040-f86636f6e5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:53.089266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 169/336] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:53.342507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1569c-f3c0-45f4-8095-47c7c7cf8a60 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:53.342789 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1569c-f3c0-45f4-8095-47c7c7cf8a60 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:53.343244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1569c-f3c0-45f4-8095-47c7c7cf8a60 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:53.345066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 168/337] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:53.350734 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21578c2d-dc6d-4625-bebd-a2438b0cd909 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:53.351327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21578c2d-dc6d-4625-bebd-a2438b0cd909 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:53.351819 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21578c2d-dc6d-4625-bebd-a2438b0cd909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:53.380999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-21578c2d-dc6d-4625-bebd-a2438b0cd909 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:53.382192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-21578c2d-dc6d-4625-bebd-a2438b0cd909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:53.443651 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:53.467545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 170/338] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:53.588694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1569c-f3c0-45f4-8095-47c7c7cf8a60 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:53.720182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1569c-f3c0-45f4-8095-47c7c7cf8a60 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:53.766806 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fb92b-c495-4684-88a7-643583030696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:53.767469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fb92b-c495-4684-88a7-643583030696 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:53.767760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fb92b-c495-4684-88a7-643583030696 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:53.768032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fb92b-c495-4684-88a7-643583030696 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:53.784440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fb92b-c495-4684-88a7-643583030696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-5a6fb92b-c495-4684-88a7-643583030696 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:53.789863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:53.790703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:53.791508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:53.793577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 169/339] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:53.799136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21578c2d-dc6d-4625-bebd-a2438b0cd909 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:53.882029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51685f-7f51-49bd-a1ea-cb2642c42677 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:53.882374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51685f-7f51-49bd-a1ea-cb2642c42677 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:53.882591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51685f-7f51-49bd-a1ea-cb2642c42677 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:53.884250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 170/340] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:53.890659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b4efc-a6f4-42a2-b39b-9d467c275c90 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:53.890944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b4efc-a6f4-42a2-b39b-9d467c275c90 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:53.891701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b4efc-a6f4-42a2-b39b-9d467c275c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:53.922778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1a6b4efc-a6f4-42a2-b39b-9d467c275c90 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:53.924083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1a6b4efc-a6f4-42a2-b39b-9d467c275c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:53.937382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21578c2d-dc6d-4625-bebd-a2438b0cd909 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:53.950148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:54.009567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a549a6-fe83-4748-a208-351e3faecb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:54.010290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a549a6-fe83-4748-a208-351e3faecb6d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:54.010572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a549a6-fe83-4748-a208-351e3faecb6d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:54.010852 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a549a6-fe83-4748-a208-351e3faecb6d None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:54.011674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a549a6-fe83-4748-a208-351e3faecb6d None admin] RBAC: Adding query filter params (name=member) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:54.011972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a549a6-fe83-4748-a208-351e3faecb6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:54.013354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a549a6-fe83-4748-a208-351e3faecb6d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:54.016858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 171/341] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:35:54.017669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b4efc-a6f4-42a2-b39b-9d467c275c90 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:54.079511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 171/342] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:54.079511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a549a6-fe83-4748-a208-351e3faecb6d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:54.149688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:54.202893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b4efc-a6f4-42a2-b39b-9d467c275c90 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:54.263637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f063c2-e3d4-4d38-ae20-e60d3fe8e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:54.264675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f063c2-e3d4-4d38-ae20-e60d3fe8e47a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:54.264869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f063c2-e3d4-4d38-ae20-e60d3fe8e47a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:54.265284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f063c2-e3d4-4d38-ae20-e60d3fe8e47a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:54.281014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a549a6-fe83-4748-a208-351e3faecb6d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:54.284201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f063c2-e3d4-4d38-ae20-e60d3fe8e47a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-b7f063c2-e3d4-4d38-ae20-e60d3fe8e47a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:54.290592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:54.292750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:54.294815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 172/343] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:35:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:54.298694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f063c2-e3d4-4d38-ae20-e60d3fe8e47a None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:54.322045 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:54.380568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddd63-a399-4358-ab41-605ed9511996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:54.381352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddd63-a399-4358-ab41-605ed9511996 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:54.381682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddd63-a399-4358-ab41-605ed9511996 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:54.381959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddd63-a399-4358-ab41-605ed9511996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:54.493000 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f063c2-e3d4-4d38-ae20-e60d3fe8e47a None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:54.517445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ddd63-a399-4358-ab41-605ed9511996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:54.517445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ddd63-a399-4358-ab41-605ed9511996 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:54.576013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f20271-0095-40a6-8d83-048adc9341f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:54.576239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:54.577131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20271-0095-40a6-8d83-048adc9341f3 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:54.577616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20271-0095-40a6-8d83-048adc9341f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:54.578096 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20271-0095-40a6-8d83-048adc9341f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:54.578981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f20271-0095-40a6-8d83-048adc9341f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:54.579510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f20271-0095-40a6-8d83-048adc9341f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:54.581088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f20271-0095-40a6-8d83-048adc9341f3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:54.594305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 173/344] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:35:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:54.595495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f20271-0095-40a6-8d83-048adc9341f3 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:54.645851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 172/345] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:54.646731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddd63-a399-4358-ab41-605ed9511996 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:54.710252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:54.749031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f20271-0095-40a6-8d83-048adc9341f3 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:54.804409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe563b-8d58-4374-958d-d94b0781cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:54.804979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe563b-8d58-4374-958d-d94b0781cb03 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:54.805269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe563b-8d58-4374-958d-d94b0781cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:54.805555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe563b-8d58-4374-958d-d94b0781cb03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:54.817522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe563b-8d58-4374-958d-d94b0781cb03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:54.821135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddd63-a399-4358-ab41-605ed9511996 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-08fe563b-8d58-4374-958d-d94b0781cb03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:54.825186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:54.826103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:54.826969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:54.831124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 174/346] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:54.832073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe563b-8d58-4374-958d-d94b0781cb03 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:54.876077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520648b-08ae-4369-bed9-ecdc75425064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:54.876755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520648b-08ae-4369-bed9-ecdc75425064 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:54.877050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520648b-08ae-4369-bed9-ecdc75425064 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:54.877326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520648b-08ae-4369-bed9-ecdc75425064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:54.891642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:54.959821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe563b-8d58-4374-958d-d94b0781cb03 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:54.970087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520648b-08ae-4369-bed9-ecdc75425064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:54.971960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520648b-08ae-4369-bed9-ecdc75425064 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:54.998034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d1038-eec2-4d5f-a055-088709562d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:54.998582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d1038-eec2-4d5f-a055-088709562d96 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:54.998878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d1038-eec2-4d5f-a055-088709562d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:54.999154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d1038-eec2-4d5f-a055-088709562d96 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.000327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d1038-eec2-4d5f-a055-088709562d96 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:55.001786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d1038-eec2-4d5f-a055-088709562d96 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:55.003445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 175/347] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:54 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:55.005265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9501fa-2abc-4afb-a3b3-78aec85ac441 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.005702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9501fa-2abc-4afb-a3b3-78aec85ac441 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.006089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9501fa-2abc-4afb-a3b3-78aec85ac441 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.011651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 176/348] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:55.012265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9501fa-2abc-4afb-a3b3-78aec85ac441 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:55.015005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:55.092497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 173/349] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:55.093938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520648b-08ae-4369-bed9-ecdc75425064 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:55.126710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9501fa-2abc-4afb-a3b3-78aec85ac441 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:55.147916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:55.168010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f59b6-18a1-4f62-a899-e8e48180a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:55.168693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f59b6-18a1-4f62-a899-e8e48180a15a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.169028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f59b6-18a1-4f62-a899-e8e48180a15a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.169320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f59b6-18a1-4f62-a899-e8e48180a15a None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.170464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f59b6-18a1-4f62-a899-e8e48180a15a None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:55.170787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f59b6-18a1-4f62-a899-e8e48180a15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:55.172621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f59b6-18a1-4f62-a899-e8e48180a15a None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:55.187361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 177/350] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:55.189054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337678e-b5e3-4264-895c-754210990be9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.191689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337678e-b5e3-4264-895c-754210990be9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.191985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337678e-b5e3-4264-895c-754210990be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.214775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b337678e-b5e3-4264-895c-754210990be9 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:55.216014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b337678e-b5e3-4264-895c-754210990be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:55.228810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520648b-08ae-4369-bed9-ecdc75425064 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:55.272320 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2414-10cc-4638-a51a-c3701f9e46bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:55.272953 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2414-10cc-4638-a51a-c3701f9e46bb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.273232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2414-10cc-4638-a51a-c3701f9e46bb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.273500 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2414-10cc-4638-a51a-c3701f9e46bb None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.281225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e2414-10cc-4638-a51a-c3701f9e46bb None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:55.282729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e2414-10cc-4638-a51a-c3701f9e46bb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:55.284410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 174/351] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:35:55 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:55.285172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2414-10cc-4638-a51a-c3701f9e46bb None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:55.286830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:55.295383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 178/352] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:55.300207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337678e-b5e3-4264-895c-754210990be9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:55.413918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2414-10cc-4638-a51a-c3701f9e46bb None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:55.418060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:55.446812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337678e-b5e3-4264-895c-754210990be9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:55.458658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77111fcd-c140-41bd-a9c1-0c023ce84a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:55.459933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77111fcd-c140-41bd-a9c1-0c023ce84a87 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.459933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77111fcd-c140-41bd-a9c1-0c023ce84a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.460344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77111fcd-c140-41bd-a9c1-0c023ce84a87 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.461638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77111fcd-c140-41bd-a9c1-0c023ce84a87 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:55.464359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77111fcd-c140-41bd-a9c1-0c023ce84a87 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:55.465908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 175/353] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:55 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:55.467168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4fee9-f0f9-4709-a589-1fbc9a38eed5 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.468832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4fee9-f0f9-4709-a589-1fbc9a38eed5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.468832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4fee9-f0f9-4709-a589-1fbc9a38eed5 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.469434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 176/354] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:55.470723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318153cd-b833-4eec-9eb6-bbb7a3c9f465 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.471021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318153cd-b833-4eec-9eb6-bbb7a3c9f465 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.471306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318153cd-b833-4eec-9eb6-bbb7a3c9f465 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.476830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 177/355] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:35:55.477839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318153cd-b833-4eec-9eb6-bbb7a3c9f465 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:55.486903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200cce-fe51-4c35-a5ef-c8805c13390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:55.488872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200cce-fe51-4c35-a5ef-c8805c13390b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.488872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200cce-fe51-4c35-a5ef-c8805c13390b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.488872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200cce-fe51-4c35-a5ef-c8805c13390b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.572648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:55.583836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200cce-fe51-4c35-a5ef-c8805c13390b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:55.587560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200cce-fe51-4c35-a5ef-c8805c13390b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:55.610287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318153cd-b833-4eec-9eb6-bbb7a3c9f465 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:55.656558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398af7-0426-46ce-b1f5-8e1171815acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:55.657175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398af7-0426-46ce-b1f5-8e1171815acc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.657455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398af7-0426-46ce-b1f5-8e1171815acc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.657729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398af7-0426-46ce-b1f5-8e1171815acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.658465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398af7-0426-46ce-b1f5-8e1171815acc None admin] RBAC: Adding query filter params (group.id=d44883f492e642449eccc43bfab70448, role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=5f268518677d45a2953a77368e9f5965) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:55.658776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398af7-0426-46ce-b1f5-8e1171815acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:55.662351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398af7-0426-46ce-b1f5-8e1171815acc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:55.670181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 178/356] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:35:55 2022] GET /identity/v3/role_assignments?group.id=d44883f492e642449eccc43bfab70448&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:55.671042 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398af7-0426-46ce-b1f5-8e1171815acc None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:55.719112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:55.730252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 179/357] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:55.732078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c011f1-e12f-40ab-92a9-fb91c69cc052 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.732078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c011f1-e12f-40ab-92a9-fb91c69cc052 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.732385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c011f1-e12f-40ab-92a9-fb91c69cc052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.755657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-16c011f1-e12f-40ab-92a9-fb91c69cc052 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:55.756893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-16c011f1-e12f-40ab-92a9-fb91c69cc052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:55.828677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398af7-0426-46ce-b1f5-8e1171815acc None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:55.843588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 180/358] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:55.844954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcd3af-b76b-4c9c-b4ca-86d0904f5769 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.845245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcd3af-b76b-4c9c-b4ca-86d0904f5769 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.845522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcd3af-b76b-4c9c-b4ca-86d0904f5769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.865796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-9cfcd3af-b76b-4c9c-b4ca-86d0904f5769 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:55.866915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9cfcd3af-b76b-4c9c-b4ca-86d0904f5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:55.872775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83db50-6717-49e9-aa93-081bf5f718b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:55.873672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83db50-6717-49e9-aa93-081bf5f718b8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:55.874171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83db50-6717-49e9-aa93-081bf5f718b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:55.874649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83db50-6717-49e9-aa93-081bf5f718b8 None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:55.877653 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83db50-6717-49e9-aa93-081bf5f718b8 None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:55.880125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83db50-6717-49e9-aa93-081bf5f718b8 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:55.882338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 179/359] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:35:55 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:55.883519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83db50-6717-49e9-aa93-081bf5f718b8 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:55.887537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:55.952677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 181/360] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:55.953924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcd3af-b76b-4c9c-b4ca-86d0904f5769 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:56.045007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83db50-6717-49e9-aa93-081bf5f718b8 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.059649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:56.070319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcd3af-b76b-4c9c-b4ca-86d0904f5769 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.106754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ad67f-3987-4cc5-ae7d-68d861306fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.107458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad67f-3987-4cc5-ae7d-68d861306fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.107744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad67f-3987-4cc5-ae7d-68d861306fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.108062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad67f-3987-4cc5-ae7d-68d861306fd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.116801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c695d-3ad9-4e99-92e5-adc78ade3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.119318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c695d-3ad9-4e99-92e5-adc78ade3a96 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.119606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c695d-3ad9-4e99-92e5-adc78ade3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.119887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c695d-3ad9-4e99-92e5-adc78ade3a96 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.121776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c695d-3ad9-4e99-92e5-adc78ade3a96 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:56.123229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c695d-3ad9-4e99-92e5-adc78ade3a96 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:56.131694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 182/361] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:55 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:56.132513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c695d-3ad9-4e99-92e5-adc78ade3a96 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:56.133434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ad67f-3987-4cc5-ae7d-68d861306fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-1e4ad67f-3987-4cc5-ae7d-68d861306fd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:56.139434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:56.140278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:35:56.141129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 180/362] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:56.153624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ad67f-3987-4cc5-ae7d-68d861306fd2 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:56.185564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:56.286735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c695d-3ad9-4e99-92e5-adc78ade3a96 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.292005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ad67f-3987-4cc5-ae7d-68d861306fd2 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.331613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5f300-0bad-4c9f-83ec-4055e6612cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.332278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5f300-0bad-4c9f-83ec-4055e6612cd8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.333071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5f300-0bad-4c9f-83ec-4055e6612cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.333343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5f300-0bad-4c9f-83ec-4055e6612cd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.334068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5f300-0bad-4c9f-83ec-4055e6612cd8 None admin] RBAC: Adding query filter params (group.id=d44883f492e642449eccc43bfab70448, role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=5f268518677d45a2953a77368e9f5965) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:56.334235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd07cf-3362-4850-b65f-696861ff0c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.334407 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5f300-0bad-4c9f-83ec-4055e6612cd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:56.335267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd07cf-3362-4850-b65f-696861ff0c15 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.335585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd07cf-3362-4850-b65f-696861ff0c15 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.335861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd07cf-3362-4850-b65f-696861ff0c15 None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.337029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd07cf-3362-4850-b65f-696861ff0c15 None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:56.338478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5f300-0bad-4c9f-83ec-4055e6612cd8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:56.341738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd07cf-3362-4850-b65f-696861ff0c15 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:56.343506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 181/363] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:35:56 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:56.344290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd07cf-3362-4850-b65f-696861ff0c15 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:56.344886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 183/364] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:35:56 2022] GET /identity/v3/role_assignments?group.id=d44883f492e642449eccc43bfab70448&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:56.345687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5f300-0bad-4c9f-83ec-4055e6612cd8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:56.401914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:56.482217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:56.506087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5f300-0bad-4c9f-83ec-4055e6612cd8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.516700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd07cf-3362-4850-b65f-696861ff0c15 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.566180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac54b1c-092f-4607-83b9-34ed2f4e8e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.566796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac54b1c-092f-4607-83b9-34ed2f4e8e33 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.567675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac54b1c-092f-4607-83b9-34ed2f4e8e33 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.567953 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac54b1c-092f-4607-83b9-34ed2f4e8e33 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.568140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4e1f2-b19a-4ddd-b19b-627308015e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.568728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac54b1c-092f-4607-83b9-34ed2f4e8e33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:56.569033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac54b1c-092f-4607-83b9-34ed2f4e8e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:56.569410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4e1f2-b19a-4ddd-b19b-627308015e4b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.569883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4e1f2-b19a-4ddd-b19b-627308015e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.570344 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4e1f2-b19a-4ddd-b19b-627308015e4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.570450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac54b1c-092f-4607-83b9-34ed2f4e8e33 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:56.581285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 182/365] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:35:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:56.582199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac54b1c-092f-4607-83b9-34ed2f4e8e33 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:56.584520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4e1f2-b19a-4ddd-b19b-627308015e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-a8a4e1f2-b19a-4ddd-b19b-627308015e4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:56.590071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:56.590951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:35:56.591754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:56.594124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 184/366] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:56.595097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4e1f2-b19a-4ddd-b19b-627308015e4b None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:56.702837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:56.712735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac54b1c-092f-4607-83b9-34ed2f4e8e33 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.723036 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4e1f2-b19a-4ddd-b19b-627308015e4b None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.750488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc246bf-96d6-45e7-9230-308863e4b056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.751518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc246bf-96d6-45e7-9230-308863e4b056 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.752012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc246bf-96d6-45e7-9230-308863e4b056 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.752599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc246bf-96d6-45e7-9230-308863e4b056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.753542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc246bf-96d6-45e7-9230-308863e4b056 None admin] RBAC: Adding query filter params (group.id=d44883f492e642449eccc43bfab70448, role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:56.754047 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc246bf-96d6-45e7-9230-308863e4b056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:56.756308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc246bf-96d6-45e7-9230-308863e4b056 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:56.762882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 183/367] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:35:56 2022] GET /identity/v3/role_assignments?group.id=d44883f492e642449eccc43bfab70448&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:56.764161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc246bf-96d6-45e7-9230-308863e4b056 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:56.768992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6ca21-ee90-49fa-88eb-fb219b574db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.770077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ca21-ee90-49fa-88eb-fb219b574db8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.770749 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ca21-ee90-49fa-88eb-fb219b574db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.771339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6ca21-ee90-49fa-88eb-fb219b574db8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.784618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6ca21-ee90-49fa-88eb-fb219b574db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-7fd6ca21-ee90-49fa-88eb-fb219b574db8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:56.791161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:56.792104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:35:56.792869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:56.796700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 185/368] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:35:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:56.797822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6ca21-ee90-49fa-88eb-fb219b574db8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:56.809523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:56.887962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc246bf-96d6-45e7-9230-308863e4b056 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.921286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6ca21-ee90-49fa-88eb-fb219b574db8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:56.926070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c3a08-a410-4ad9-a656-bb1236ad5ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.927465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c3a08-a410-4ad9-a656-bb1236ad5ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.927894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c3a08-a410-4ad9-a656-bb1236ad5ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.928565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c3a08-a410-4ad9-a656-bb1236ad5ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.964152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:56.969824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98bbb0-d20a-439c-86fe-278b7f3388f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:56.970734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98bbb0-d20a-439c-86fe-278b7f3388f0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:56.971225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98bbb0-d20a-439c-86fe-278b7f3388f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:56.971744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98bbb0-d20a-439c-86fe-278b7f3388f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:56.972622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98bbb0-d20a-439c-86fe-278b7f3388f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:56.973191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98bbb0-d20a-439c-86fe-278b7f3388f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:56.974865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98bbb0-d20a-439c-86fe-278b7f3388f0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:56.997374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 186/369] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:56.998580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98bbb0-d20a-439c-86fe-278b7f3388f0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:57.007616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c3a08-a410-4ad9-a656-bb1236ad5ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:57.009114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c3a08-a410-4ad9-a656-bb1236ad5ac5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:57.118521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 184/370] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:57.119406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c3a08-a410-4ad9-a656-bb1236ad5ac5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:57.122243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:57.191739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:57.217575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98bbb0-d20a-439c-86fe-278b7f3388f0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:57.227007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c3a08-a410-4ad9-a656-bb1236ad5ac5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:57.274642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22904aef-deab-463d-81ff-90742a3fe5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:57.275281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904aef-deab-463d-81ff-90742a3fe5fe None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:57.275584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904aef-deab-463d-81ff-90742a3fe5fe None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:57.275857 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22904aef-deab-463d-81ff-90742a3fe5fe None admin] PATH_INFO: `/v3/users/aedd00e5898a485b89756ead1e01d80b` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:57.277084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22904aef-deab-463d-81ff-90742a3fe5fe None admin] RBAC: Authorizing `identity:get_user(user_id=aedd00e5898a485b89756ead1e01d80b)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:57.278543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22904aef-deab-463d-81ff-90742a3fe5fe None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:57.280200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 185/371] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:35:57 2022] GET /identity/v3/users/aedd00e5898a485b89756ead1e01d80b => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:57.280966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22904aef-deab-463d-81ff-90742a3fe5fe None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:57.308032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dc821-26a3-444d-b117-e37833193e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:57.308666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dc821-26a3-444d-b117-e37833193e9c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:57.308951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dc821-26a3-444d-b117-e37833193e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:57.309235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dc821-26a3-444d-b117-e37833193e9c None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:57.309911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dc821-26a3-444d-b117-e37833193e9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:57.310493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dc821-26a3-444d-b117-e37833193e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:57.311652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dc821-26a3-444d-b117-e37833193e9c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:57.326641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 187/372] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:57.335315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dc821-26a3-444d-b117-e37833193e9c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:57.459235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dc821-26a3-444d-b117-e37833193e9c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:57.492603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:57.495742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22904aef-deab-463d-81ff-90742a3fe5fe None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:57.507410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3c7f-31b4-4eaf-8418-0ff5987981b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:57.508035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3c7f-31b4-4eaf-8418-0ff5987981b0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:57.508328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3c7f-31b4-4eaf-8418-0ff5987981b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:57.508608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3c7f-31b4-4eaf-8418-0ff5987981b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:57.509324 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3c7f-31b4-4eaf-8418-0ff5987981b0 None admin] RBAC: Adding query filter params (role.id=eafae458ff434a238f62753799a89414, user.id=aedd00e5898a485b89756ead1e01d80b, scope.system=all) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:57.509633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3c7f-31b4-4eaf-8418-0ff5987981b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:57.511089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3c7f-31b4-4eaf-8418-0ff5987981b0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:57.532073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 188/373] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 24 07:35:57 2022] GET /identity/v3/role_assignments?user.id=aedd00e5898a485b89756ead1e01d80b&scope.system=all&role.id=eafae458ff434a238f62753799a89414 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:57.534174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3c7f-31b4-4eaf-8418-0ff5987981b0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:57.564381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:57.594794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c17bb-4dee-490d-9a9c-b544d693e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:57.595472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c17bb-4dee-490d-9a9c-b544d693e026 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:57.595757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c17bb-4dee-490d-9a9c-b544d693e026 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:57.596035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c17bb-4dee-490d-9a9c-b544d693e026 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:57.600807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c17bb-4dee-490d-9a9c-b544d693e026 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:57.602296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c17bb-4dee-490d-9a9c-b544d693e026 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:57.604028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 186/374] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:57 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:57.609590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c17bb-4dee-490d-9a9c-b544d693e026 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:57.754262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3c7f-31b4-4eaf-8418-0ff5987981b0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:57.796359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18494df6-d1af-4024-b1f5-6d29e01db9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:57.796956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18494df6-d1af-4024-b1f5-6d29e01db9ed None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:57.797235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18494df6-d1af-4024-b1f5-6d29e01db9ed None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:57.797511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18494df6-d1af-4024-b1f5-6d29e01db9ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:57.859919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c17bb-4dee-490d-9a9c-b544d693e026 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:57.863430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:57.884634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18494df6-d1af-4024-b1f5-6d29e01db9ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:57.886140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18494df6-d1af-4024-b1f5-6d29e01db9ed None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:57.916938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c724596-b302-432b-93b4-8acb366df521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:57.917594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c724596-b302-432b-93b4-8acb366df521 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:57.917885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c724596-b302-432b-93b4-8acb366df521 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:57.918160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c724596-b302-432b-93b4-8acb366df521 None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:57.919315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c724596-b302-432b-93b4-8acb366df521 None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:57.920780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c724596-b302-432b-93b4-8acb366df521 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:57.927395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 187/375] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:35:57 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:57.929257 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c724596-b302-432b-93b4-8acb366df521 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:58.015088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 189/376] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:58.020196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18494df6-d1af-4024-b1f5-6d29e01db9ed None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:58.056849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:58.119935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c724596-b302-432b-93b4-8acb366df521 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:58.159265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:58.175508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8910a-eacf-4053-a94c-96f7ee57810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:58.177010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8910a-eacf-4053-a94c-96f7ee57810a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:58.177489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8910a-eacf-4053-a94c-96f7ee57810a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:58.177959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8910a-eacf-4053-a94c-96f7ee57810a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:58.178900 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18494df6-d1af-4024-b1f5-6d29e01db9ed None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:58.179499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8910a-eacf-4053-a94c-96f7ee57810a None admin] RBAC: Adding query filter params (group.id=d44883f492e642449eccc43bfab70448, role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:58.180006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8910a-eacf-4053-a94c-96f7ee57810a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:58.181644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8910a-eacf-4053-a94c-96f7ee57810a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:58.188324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 188/377] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:35:57 2022] GET /identity/v3/role_assignments?group.id=d44883f492e642449eccc43bfab70448&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:58.214646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5206-ba85-428f-9975-c06bc9e86fd6 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:58.215280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5206-ba85-428f-9975-c06bc9e86fd6 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:58.215797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5206-ba85-428f-9975-c06bc9e86fd6 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:58.217618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 189/378] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:58.224194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987cccb-a330-47d9-a74c-153db013f703 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:58.224383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb5a1c-255b-4939-96bb-c08226e791d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:58.224932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987cccb-a330-47d9-a74c-153db013f703 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:58.225046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb5a1c-255b-4939-96bb-c08226e791d7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:58.225287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb5a1c-255b-4939-96bb-c08226e791d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:58.225559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb5a1c-255b-4939-96bb-c08226e791d7 None admin] PATH_INFO: `/v3/projects/0aa975bb77094d52bcdbb2bd261327d8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:58.225896 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987cccb-a330-47d9-a74c-153db013f703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:58.226801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb5a1c-255b-4939-96bb-c08226e791d7 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa975bb77094d52bcdbb2bd261327d8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:58.228411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb5a1c-255b-4939-96bb-c08226e791d7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:58.233741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 190/379] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:58 2022] GET /identity/v3/projects/0aa975bb77094d52bcdbb2bd261327d8 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:58.236062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb5a1c-255b-4939-96bb-c08226e791d7 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:58.260437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2987cccb-a330-47d9-a74c-153db013f703 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:58.262167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2987cccb-a330-47d9-a74c-153db013f703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:58.352534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 190/380] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:58.355417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb5a1c-255b-4939-96bb-c08226e791d7 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:58.390974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2568-3927-4140-ac77-322f94615ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:58.391633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2568-3927-4140-ac77-322f94615ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:58.391911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2568-3927-4140-ac77-322f94615ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:58.392179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba2568-3927-4140-ac77-322f94615ad2 None admin] PATH_INFO: `/v3/groups/127bf94cc71b42029536ad447dcf0ab0` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:58.399175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba2568-3927-4140-ac77-322f94615ad2 None admin] RBAC: Authorizing `identity:get_group(group_id=127bf94cc71b42029536ad447dcf0ab0)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:58.400650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba2568-3927-4140-ac77-322f94615ad2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:58.402261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 191/381] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:35:58 2022] GET /identity/v3/groups/127bf94cc71b42029536ad447dcf0ab0 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:58.408062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987cccb-a330-47d9-a74c-153db013f703 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:58.470950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:58.522940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987cccb-a330-47d9-a74c-153db013f703 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:58.560074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec601d-9dfe-41cf-8cd0-5b85f498132c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:58.561104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec601d-9dfe-41cf-8cd0-5b85f498132c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:58.561581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec601d-9dfe-41cf-8cd0-5b85f498132c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:58.562109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec601d-9dfe-41cf-8cd0-5b85f498132c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:58.563035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec601d-9dfe-41cf-8cd0-5b85f498132c None admin] RBAC: Adding query filter params (group.id=127bf94cc71b42029536ad447dcf0ab0, role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=0aa975bb77094d52bcdbb2bd261327d8) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:58.563569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec601d-9dfe-41cf-8cd0-5b85f498132c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:58.565202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec601d-9dfe-41cf-8cd0-5b85f498132c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:58.572147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 191/382] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:35:58 2022] GET /identity/v3/role_assignments?group.id=127bf94cc71b42029536ad447dcf0ab0&scope.project.id=0aa975bb77094d52bcdbb2bd261327d8&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:58.742271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2568-3927-4140-ac77-322f94615ad2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:58.768149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:58.872371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba2568-3927-4140-ac77-322f94615ad2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:58.912964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e16482-97b5-4c99-90ea-1ddcb4ccd696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:58.913603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16482-97b5-4c99-90ea-1ddcb4ccd696 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:58.913883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16482-97b5-4c99-90ea-1ddcb4ccd696 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:58.914160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e16482-97b5-4c99-90ea-1ddcb4ccd696 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:58.925025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e16482-97b5-4c99-90ea-1ddcb4ccd696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-f6e16482-97b5-4c99-90ea-1ddcb4ccd696 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:58.930292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:58.931169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:35:58.932017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:58.935400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 192/383] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:35:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:35:58.937731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec601d-9dfe-41cf-8cd0-5b85f498132c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:59.082928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec601d-9dfe-41cf-8cd0-5b85f498132c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:59.102316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3fdb3-3131-4d16-9506-2134c5a95a43 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:59.102871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3fdb3-3131-4d16-9506-2134c5a95a43 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:59.103374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3fdb3-3131-4d16-9506-2134c5a95a43 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:59.105183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 193/384] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:59.111663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:59.122900 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4825e38-f1fb-4132-a971-416eb0576f6a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:59.123530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4825e38-f1fb-4132-a971-416eb0576f6a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:59.124003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4825e38-f1fb-4132-a971-416eb0576f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:59.136514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dfc6d-8f35-42df-b5c0-ffc4d5e67d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:59.137143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dfc6d-8f35-42df-b5c0-ffc4d5e67d3e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:59.137404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dfc6d-8f35-42df-b5c0-ffc4d5e67d3e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:59.137675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dfc6d-8f35-42df-b5c0-ffc4d5e67d3e None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:59.138350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dfc6d-8f35-42df-b5c0-ffc4d5e67d3e None admin] RBAC: Adding query filter params (name=member) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:35:59.138654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dfc6d-8f35-42df-b5c0-ffc4d5e67d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:59.140055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dfc6d-8f35-42df-b5c0-ffc4d5e67d3e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:59.158814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e4825e38-f1fb-4132-a971-416eb0576f6a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:59.160044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e4825e38-f1fb-4132-a971-416eb0576f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:35:59.163740 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 192/385] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:35:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:59.169467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dfc6d-8f35-42df-b5c0-ffc4d5e67d3e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:59.269529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 194/386] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:35:59.278390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dfc6d-8f35-42df-b5c0-ffc4d5e67d3e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:59.315068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe3a33-7a62-4e43-9a6c-57f7abd62650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:59.315736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe3a33-7a62-4e43-9a6c-57f7abd62650 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:59.316013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe3a33-7a62-4e43-9a6c-57f7abd62650 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:59.316284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe3a33-7a62-4e43-9a6c-57f7abd62650 None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:59.317810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe3a33-7a62-4e43-9a6c-57f7abd62650 None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:59.319256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe3a33-7a62-4e43-9a6c-57f7abd62650 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:59.321167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 193/387] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:35:59 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:35:59.326554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4825e38-f1fb-4132-a971-416eb0576f6a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:59.361313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:59.470245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4825e38-f1fb-4132-a971-416eb0576f6a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:59.514785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e281482-bff5-4b7e-b104-7c8d296964cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:59.515467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e281482-bff5-4b7e-b104-7c8d296964cd None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:59.515751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e281482-bff5-4b7e-b104-7c8d296964cd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:59.516026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e281482-bff5-4b7e-b104-7c8d296964cd None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:59.517175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e281482-bff5-4b7e-b104-7c8d296964cd None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:59.518609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e281482-bff5-4b7e-b104-7c8d296964cd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:59.521011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 195/388] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:35:59 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:35:59.526944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe3a33-7a62-4e43-9a6c-57f7abd62650 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:59.608516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:59.623708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e281482-bff5-4b7e-b104-7c8d296964cd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:59.694135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe3a33-7a62-4e43-9a6c-57f7abd62650 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:59.734629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:59.755889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e281482-bff5-4b7e-b104-7c8d296964cd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:59.797387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5a72-6a57-4638-8d22-9c529e86d882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:59.798395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5a72-6a57-4638-8d22-9c529e86d882 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:59.798905 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5a72-6a57-4638-8d22-9c529e86d882 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:59.799410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5a72-6a57-4638-8d22-9c529e86d882 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:59.815054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a5a72-6a57-4638-8d22-9c529e86d882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:35:59.815991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91448-856a-4859-a07f-d0d12088ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:35:59.816984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91448-856a-4859-a07f-d0d12088ecfb None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:59.817277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91448-856a-4859-a07f-d0d12088ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:59.817556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91448-856a-4859-a07f-d0d12088ecfb None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965/groups/d44883f492e642449eccc43bfab70448/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:59.819578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91448-856a-4859-a07f-d0d12088ecfb None admin] RBAC: Authorizing `identity:create_grant(project_id=5f268518677d45a2953a77368e9f5965, group_id=d44883f492e642449eccc43bfab70448, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:35:59.821029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91448-856a-4859-a07f-d0d12088ecfb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-2b3a5a72-6a57-4638-8d22-9c529e86d882 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:35:59.822039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:35:59.822885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:35:59.823682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:35:59.834970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 196/389] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:35:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:35:59.836216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5a72-6a57-4638-8d22-9c529e86d882 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:35:59.913703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 194/390] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 07:35:59 2022] PUT /identity/v3/projects/5f268518677d45a2953a77368e9f5965/groups/d44883f492e642449eccc43bfab70448/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:35:59.923431 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225db266-2ae0-45b4-9a9e-8d278c707e68 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:59.923846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225db266-2ae0-45b4-9a9e-8d278c707e68 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:59.924028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225db266-2ae0-45b4-9a9e-8d278c707e68 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:59.927114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 195/391] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:35:59.932744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade5c5-b9c5-44a5-b32a-87ef83d574d1 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:35:59.932744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade5c5-b9c5-44a5-b32a-87ef83d574d1 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:35:59.932744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade5c5-b9c5-44a5-b32a-87ef83d574d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:35:59.961756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5a72-6a57-4638-8d22-9c529e86d882 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:35:59.966211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-79ade5c5-b9c5-44a5-b32a-87ef83d574d1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:35:59.967463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-79ade5c5-b9c5-44a5-b32a-87ef83d574d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:00.016229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15973f-c4d1-4348-a575-5440bbd7377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:00.016861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15973f-c4d1-4348-a575-5440bbd7377d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:00.017138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15973f-c4d1-4348-a575-5440bbd7377d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:00.017461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15973f-c4d1-4348-a575-5440bbd7377d None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:00.018077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15973f-c4d1-4348-a575-5440bbd7377d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:00.018378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15973f-c4d1-4348-a575-5440bbd7377d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:00.020411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15973f-c4d1-4348-a575-5440bbd7377d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:00.025981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:00.033240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 197/392] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:35:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:00.039849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15973f-c4d1-4348-a575-5440bbd7377d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:00.063633 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 196/393] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:00.193495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15973f-c4d1-4348-a575-5440bbd7377d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:00.232479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24611b0-b80b-4391-836b-a1a43d3fbbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:00.233115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24611b0-b80b-4391-836b-a1a43d3fbbd5 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:00.233403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24611b0-b80b-4391-836b-a1a43d3fbbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:00.233678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24611b0-b80b-4391-836b-a1a43d3fbbd5 None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:00.234792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24611b0-b80b-4391-836b-a1a43d3fbbd5 None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:00.236354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24611b0-b80b-4391-836b-a1a43d3fbbd5 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:00.238296 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 198/394] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:36:00 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:00.243822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade5c5-b9c5-44a5-b32a-87ef83d574d1 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:00.294640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:00.355263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade5c5-b9c5-44a5-b32a-87ef83d574d1 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:00.405121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7d7b-ae81-426f-9de7-4205d255af63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:00.405772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7d7b-ae81-426f-9de7-4205d255af63 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:00.406056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7d7b-ae81-426f-9de7-4205d255af63 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:00.406331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7d7b-ae81-426f-9de7-4205d255af63 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:00.407514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c7d7b-ae81-426f-9de7-4205d255af63 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:00.408958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c7d7b-ae81-426f-9de7-4205d255af63 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:00.411121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 197/395] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:36:00 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:00.417215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24611b0-b80b-4391-836b-a1a43d3fbbd5 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:00.433355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7d7b-ae81-426f-9de7-4205d255af63 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:00.564585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7d7b-ae81-426f-9de7-4205d255af63 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:00.567727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:00.576514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:00.606067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154bc54-6483-4118-b71a-a27539ef1118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:00.606714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154bc54-6483-4118-b71a-a27539ef1118 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:00.607054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154bc54-6483-4118-b71a-a27539ef1118 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:00.607360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154bc54-6483-4118-b71a-a27539ef1118 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:00.620386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154bc54-6483-4118-b71a-a27539ef1118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-3154bc54-6483-4118-b71a-a27539ef1118 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:00.626673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:00.627577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:00.628367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 198/396] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:00.629945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b373ca-e819-4a20-8349-34eea579fed2 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:00.630232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b373ca-e819-4a20-8349-34eea579fed2 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:00.630500 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b373ca-e819-4a20-8349-34eea579fed2 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:00.635939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 199/397] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:00.635939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b373ca-e819-4a20-8349-34eea579fed2 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:00.649375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24611b0-b80b-4391-836b-a1a43d3fbbd5 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:00.692871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faa0d3-c5ad-4bd2-b69c-4af115d3deec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:00.693541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faa0d3-c5ad-4bd2-b69c-4af115d3deec None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:00.693972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faa0d3-c5ad-4bd2-b69c-4af115d3deec None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:00.694255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faa0d3-c5ad-4bd2-b69c-4af115d3deec None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965/groups/d44883f492e642449eccc43bfab70448/roles/b1bfc74339e44fc983bfb20cbf2bda25` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:00.697104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faa0d3-c5ad-4bd2-b69c-4af115d3deec None admin] RBAC: Authorizing `identity:create_grant(project_id=5f268518677d45a2953a77368e9f5965, group_id=d44883f492e642449eccc43bfab70448, role_id=b1bfc74339e44fc983bfb20cbf2bda25)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:00.699041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faa0d3-c5ad-4bd2-b69c-4af115d3deec None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:00.771327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 199/398] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 07:36:00 2022] PUT /identity/v3/projects/5f268518677d45a2953a77368e9f5965/groups/d44883f492e642449eccc43bfab70448/roles/b1bfc74339e44fc983bfb20cbf2bda25 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:36:00.771524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b373ca-e819-4a20-8349-34eea579fed2 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:00.771604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f38a-a25d-4f68-8140-5ff5d461a6ef None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:00.771604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f38a-a25d-4f68-8140-5ff5d461a6ef None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:00.771604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f38a-a25d-4f68-8140-5ff5d461a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:00.804708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-dac6f38a-a25d-4f68-8140-5ff5d461a6ef None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:00.805953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-dac6f38a-a25d-4f68-8140-5ff5d461a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:00.845825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7a3b7-54a6-4418-9997-fe5650cd9e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:00.846363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7a3b7-54a6-4418-9997-fe5650cd9e1b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:00.846647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7a3b7-54a6-4418-9997-fe5650cd9e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:00.846929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7a3b7-54a6-4418-9997-fe5650cd9e1b None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:00.847640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7a3b7-54a6-4418-9997-fe5650cd9e1b None admin] RBAC: Adding query filter params (name=member) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:00.848013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7a3b7-54a6-4418-9997-fe5650cd9e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:00.852297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7a3b7-54a6-4418-9997-fe5650cd9e1b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:00.875137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 200/399] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:36:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:00.881128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7a3b7-54a6-4418-9997-fe5650cd9e1b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:00.929183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:00.954525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 200/400] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:01.000421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f614-1a25-4874-9a3f-cb81caf6aca3 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:01.000986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f614-1a25-4874-9a3f-cb81caf6aca3 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:01.001487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f614-1a25-4874-9a3f-cb81caf6aca3 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:01.003069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 201/401] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:36:01.010899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680a27-884c-4da6-b7fe-d2ae59de483b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:01.011186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680a27-884c-4da6-b7fe-d2ae59de483b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:01.011507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680a27-884c-4da6-b7fe-d2ae59de483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:01.014122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7a3b7-54a6-4418-9997-fe5650cd9e1b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:01.041450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-41680a27-884c-4da6-b7fe-d2ae59de483b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:01.043603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-41680a27-884c-4da6-b7fe-d2ae59de483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:01.056450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb720e25-8a05-4d33-a8ad-0c153d370fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:01.057439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb720e25-8a05-4d33-a8ad-0c153d370fbf None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:01.057957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb720e25-8a05-4d33-a8ad-0c153d370fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:01.058438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb720e25-8a05-4d33-a8ad-0c153d370fbf None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:01.059794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb720e25-8a05-4d33-a8ad-0c153d370fbf None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:01.061573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb720e25-8a05-4d33-a8ad-0c153d370fbf None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:01.063725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 201/402] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:36:00 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:01.069463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb720e25-8a05-4d33-a8ad-0c153d370fbf None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:01.152884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:01.169023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 202/403] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:01.240243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:01.244202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb720e25-8a05-4d33-a8ad-0c153d370fbf None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:01.265819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41680a27-884c-4da6-b7fe-d2ae59de483b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:01.308736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af956f-8c54-47a0-9256-fa6750938710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:01.309843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af956f-8c54-47a0-9256-fa6750938710 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:01.310358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af956f-8c54-47a0-9256-fa6750938710 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:01.310841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af956f-8c54-47a0-9256-fa6750938710 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:01.312342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af956f-8c54-47a0-9256-fa6750938710 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:01.314171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af956f-8c54-47a0-9256-fa6750938710 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:01.316146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 202/404] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:36:01 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:01.321998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af956f-8c54-47a0-9256-fa6750938710 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:01.415958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41680a27-884c-4da6-b7fe-d2ae59de483b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:01.442536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af956f-8c54-47a0-9256-fa6750938710 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:01.460964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623b429-5f71-403c-a74a-8365a8f1ff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:01.461633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623b429-5f71-403c-a74a-8365a8f1ff4c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:01.461915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623b429-5f71-403c-a74a-8365a8f1ff4c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:01.462185 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623b429-5f71-403c-a74a-8365a8f1ff4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:01.480429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623b429-5f71-403c-a74a-8365a8f1ff4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:01.483636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458defe-a8aa-4cda-b679-12e0fc445b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:01.484552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458defe-a8aa-4cda-b679-12e0fc445b49 None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:01.485025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458defe-a8aa-4cda-b679-12e0fc445b49 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-0623b429-5f71-403c-a74a-8365a8f1ff4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:01.485493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:01.486326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:36:01.487106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:01.487751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458defe-a8aa-4cda-b679-12e0fc445b49 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/groups/d44883f492e642449eccc43bfab70448/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:01.491160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458defe-a8aa-4cda-b679-12e0fc445b49 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4f53e5afc1d4015a10f92f1b6923fab, group_id=d44883f492e642449eccc43bfab70448, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:01.491697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 203/405] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:01.493121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458defe-a8aa-4cda-b679-12e0fc445b49 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:01.496191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623b429-5f71-403c-a74a-8365a8f1ff4c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:01.547936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:01.584612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 203/406] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 07:36:01 2022] PUT /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/groups/d44883f492e642449eccc43bfab70448/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:36:01.586184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458defe-a8aa-4cda-b679-12e0fc445b49 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:01.602859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623b429-5f71-403c-a74a-8365a8f1ff4c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:01.627799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:01.657197 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9e581-22e3-40a4-8f16-7c138970389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:01.657835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9e581-22e3-40a4-8f16-7c138970389f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:01.658120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9e581-22e3-40a4-8f16-7c138970389f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:01.658402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9e581-22e3-40a4-8f16-7c138970389f None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:01.659082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9e581-22e3-40a4-8f16-7c138970389f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:01.659471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9e581-22e3-40a4-8f16-7c138970389f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:01.661598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9e581-22e3-40a4-8f16-7c138970389f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:01.671908 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 204/407] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:01.678548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9e581-22e3-40a4-8f16-7c138970389f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:01.738550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458defe-a8aa-4cda-b679-12e0fc445b49 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:01.794267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfec8e-1955-4c12-b819-bbd9dfb4eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:01.795101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfec8e-1955-4c12-b819-bbd9dfb4eb8b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:01.795403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfec8e-1955-4c12-b819-bbd9dfb4eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:01.795683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfec8e-1955-4c12-b819-bbd9dfb4eb8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:01.810035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfec8e-1955-4c12-b819-bbd9dfb4eb8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-07cfec8e-1955-4c12-b819-bbd9dfb4eb8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:01.816958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:01.817841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:01.818672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 204/408] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:01.824554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfec8e-1955-4c12-b819-bbd9dfb4eb8b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:01.843231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9e581-22e3-40a4-8f16-7c138970389f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:01.867650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:01.912442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1afc29-9eaa-4a57-9c1f-c2a1690f44b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:01.913083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1afc29-9eaa-4a57-9c1f-c2a1690f44b4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:01.913363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1afc29-9eaa-4a57-9c1f-c2a1690f44b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:01.913636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1afc29-9eaa-4a57-9c1f-c2a1690f44b4 None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:01.914939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1afc29-9eaa-4a57-9c1f-c2a1690f44b4 None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:01.916409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1afc29-9eaa-4a57-9c1f-c2a1690f44b4 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:01.917991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 205/409] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:36:01 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:01.930986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1afc29-9eaa-4a57-9c1f-c2a1690f44b4 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:02.007888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:02.037753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfec8e-1955-4c12-b819-bbd9dfb4eb8b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:02.110083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e2bf0-678a-4476-b626-29e888759843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:02.110707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2bf0-678a-4476-b626-29e888759843 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:02.111053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2bf0-678a-4476-b626-29e888759843 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:02.111354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e2bf0-678a-4476-b626-29e888759843 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:02.112082 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2bf0-678a-4476-b626-29e888759843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:02.112395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2bf0-678a-4476-b626-29e888759843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:02.115721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e2bf0-678a-4476-b626-29e888759843 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:02.129950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1afc29-9eaa-4a57-9c1f-c2a1690f44b4 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:02.133293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 205/410] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:02.138804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e2bf0-678a-4476-b626-29e888759843 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:02.200214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcf8d2-407f-4a1d-aefd-940150f1bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:02.200773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcf8d2-407f-4a1d-aefd-940150f1bc35 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:02.201055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcf8d2-407f-4a1d-aefd-940150f1bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:02.201327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcf8d2-407f-4a1d-aefd-940150f1bc35 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:02.203486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcf8d2-407f-4a1d-aefd-940150f1bc35 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:02.205697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcf8d2-407f-4a1d-aefd-940150f1bc35 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:02.216160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 206/411] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:36:01 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:02.217361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcf8d2-407f-4a1d-aefd-940150f1bc35 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:02.309745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:02.347764 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e2bf0-678a-4476-b626-29e888759843 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:02.400887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcf8d2-407f-4a1d-aefd-940150f1bc35 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:02.403959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3480c-6149-41d6-8470-73e441dff15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:02.404593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3480c-6149-41d6-8470-73e441dff15f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:02.404870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3480c-6149-41d6-8470-73e441dff15f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:02.405139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3480c-6149-41d6-8470-73e441dff15f None admin] PATH_INFO: `/v3/groups/127bf94cc71b42029536ad447dcf0ab0` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:02.406249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3480c-6149-41d6-8470-73e441dff15f None admin] RBAC: Authorizing `identity:get_group(group_id=127bf94cc71b42029536ad447dcf0ab0)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:02.407846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3480c-6149-41d6-8470-73e441dff15f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:02.414251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 206/412] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:36:02 2022] GET /identity/v3/groups/127bf94cc71b42029536ad447dcf0ab0 => generated 229 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:02.415651 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bc158-2580-47d5-9e6e-f803d8b0bf61 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:02.415928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bc158-2580-47d5-9e6e-f803d8b0bf61 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:02.416197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bc158-2580-47d5-9e6e-f803d8b0bf61 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:02.417805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 207/413] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:02.418614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bc158-2580-47d5-9e6e-f803d8b0bf61 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:02.436647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf5523-7213-43d9-aeea-313327c7b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:02.437402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf5523-7213-43d9-aeea-313327c7b3c4 None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:02.437691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf5523-7213-43d9-aeea-313327c7b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:02.437968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf5523-7213-43d9-aeea-313327c7b3c4 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/groups/d44883f492e642449eccc43bfab70448/roles/b1bfc74339e44fc983bfb20cbf2bda25` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:02.440186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf5523-7213-43d9-aeea-313327c7b3c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4f53e5afc1d4015a10f92f1b6923fab, group_id=d44883f492e642449eccc43bfab70448, role_id=b1bfc74339e44fc983bfb20cbf2bda25)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:02.441714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf5523-7213-43d9-aeea-313327c7b3c4 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:02.443985 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:02.527729 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 207/414] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 07:36:02 2022] PUT /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab/groups/d44883f492e642449eccc43bfab70448/roles/b1bfc74339e44fc983bfb20cbf2bda25 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:36:02.529815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dab48-184c-4b6c-8147-324d63b6fc4b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:02.530303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dab48-184c-4b6c-8147-324d63b6fc4b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:02.530771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dab48-184c-4b6c-8147-324d63b6fc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:02.544658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bc158-2580-47d5-9e6e-f803d8b0bf61 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:02.557246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3e4dab48-184c-4b6c-8147-324d63b6fc4b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:02.558887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3e4dab48-184c-4b6c-8147-324d63b6fc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:02.624592 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fcab1-dd4c-40b5-ad94-c682d14b2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:02.626686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fcab1-dd4c-40b5-ad94-c682d14b2d77 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:02.627366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fcab1-dd4c-40b5-ad94-c682d14b2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:02.628587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fcab1-dd4c-40b5-ad94-c682d14b2d77 None admin] PATH_INFO: `/v3/projects/0aa975bb77094d52bcdbb2bd261327d8` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:02.631134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fcab1-dd4c-40b5-ad94-c682d14b2d77 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa975bb77094d52bcdbb2bd261327d8)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:02.633994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fcab1-dd4c-40b5-ad94-c682d14b2d77 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:02.637976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 208/415] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:36:02 2022] GET /identity/v3/projects/0aa975bb77094d52bcdbb2bd261327d8 => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:02.643853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fcab1-dd4c-40b5-ad94-c682d14b2d77 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:02.717270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 208/416] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:02.750424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:02.770531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fcab1-dd4c-40b5-ad94-c682d14b2d77 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:02.808662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ab117-47aa-4cd8-9d46-7b1554919f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:02.809259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ab117-47aa-4cd8-9d46-7b1554919f37 None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:02.809542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ab117-47aa-4cd8-9d46-7b1554919f37 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:02.809824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ab117-47aa-4cd8-9d46-7b1554919f37 None admin] PATH_INFO: `/v3/projects/0aa975bb77094d52bcdbb2bd261327d8/groups/127bf94cc71b42029536ad447dcf0ab0/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:02.811853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ab117-47aa-4cd8-9d46-7b1554919f37 None admin] RBAC: Authorizing `identity:create_grant(project_id=0aa975bb77094d52bcdbb2bd261327d8, group_id=127bf94cc71b42029536ad447dcf0ab0, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:02.813315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ab117-47aa-4cd8-9d46-7b1554919f37 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:02.896177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 209/417] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 24 07:36:02 2022] PUT /identity/v3/projects/0aa975bb77094d52bcdbb2bd261327d8/groups/127bf94cc71b42029536ad447dcf0ab0/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:36:03.018663 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dab48-184c-4b6c-8147-324d63b6fc4b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:03.059459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:03.095749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee15106-e44f-431f-9f08-a9ec2ecb9f5d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:03.096058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee15106-e44f-431f-9f08-a9ec2ecb9f5d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:03.096317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee15106-e44f-431f-9f08-a9ec2ecb9f5d None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:03.103588 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 210/418] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:03.109709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff55ab-4549-444c-ab53-d6817098655a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:03.109994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff55ab-4549-444c-ab53-d6817098655a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:03.110419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff55ab-4549-444c-ab53-d6817098655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:03.135074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dab48-184c-4b6c-8147-324d63b6fc4b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:03.136230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-77ff55ab-4549-444c-ab53-d6817098655a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:03.137589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-77ff55ab-4549-444c-ab53-d6817098655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:03.187564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56284d2-f9b7-49ab-b847-8fba0a92781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:03.188207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56284d2-f9b7-49ab-b847-8fba0a92781c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:03.188486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56284d2-f9b7-49ab-b847-8fba0a92781c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:03.188756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56284d2-f9b7-49ab-b847-8fba0a92781c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:03.216539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56284d2-f9b7-49ab-b847-8fba0a92781c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-a56284d2-f9b7-49ab-b847-8fba0a92781c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:03.221354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:03.222226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:03.223871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 209/419] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:03.228784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56284d2-f9b7-49ab-b847-8fba0a92781c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:03.273455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 211/420] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:03.355461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56284d2-f9b7-49ab-b847-8fba0a92781c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:03.357020 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:03.392533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aea81-8fec-454a-9416-89314d1be64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:03.393139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aea81-8fec-454a-9416-89314d1be64f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:03.393415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aea81-8fec-454a-9416-89314d1be64f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:03.393686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aea81-8fec-454a-9416-89314d1be64f None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:03.394354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aea81-8fec-454a-9416-89314d1be64f None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:03.395697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aea81-8fec-454a-9416-89314d1be64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:03.399014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aea81-8fec-454a-9416-89314d1be64f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:03.411342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 210/421] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:36:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:03.420393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff55ab-4549-444c-ab53-d6817098655a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:03.517284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:03.547518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff55ab-4549-444c-ab53-d6817098655a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:03.596562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8970936-c429-4696-9ff2-68d9b4ecb5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:03.597186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8970936-c429-4696-9ff2-68d9b4ecb5ce None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:03.597481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8970936-c429-4696-9ff2-68d9b4ecb5ce None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:03.597843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8970936-c429-4696-9ff2-68d9b4ecb5ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:03.634694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aea81-8fec-454a-9416-89314d1be64f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:03.708545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8970936-c429-4696-9ff2-68d9b4ecb5ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:03.715307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8970936-c429-4696-9ff2-68d9b4ecb5ce None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:03.766392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aea81-8fec-454a-9416-89314d1be64f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:03.819130 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:03.830828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7e2cb-7546-4862-b2b6-85a0b17efd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:03.836047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e2cb-7546-4862-b2b6-85a0b17efd34 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:03.836047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e2cb-7546-4862-b2b6-85a0b17efd34 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:03.836047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7e2cb-7546-4862-b2b6-85a0b17efd34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:03.857068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7e2cb-7546-4862-b2b6-85a0b17efd34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-98f7e2cb-7546-4862-b2b6-85a0b17efd34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:03.862702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:03.864358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:36:03.865383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:03.870809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 212/422] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:03.872419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 211/423] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:03.884385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7e2cb-7546-4862-b2b6-85a0b17efd34 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:03.884570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8970936-c429-4696-9ff2-68d9b4ecb5ce None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:03.926351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:04.028778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7e2cb-7546-4862-b2b6-85a0b17efd34 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:04.053858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8970936-c429-4696-9ff2-68d9b4ecb5ce None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:04.069522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a3ea1-88b1-46f0-90ae-b4c07a096930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:04.070138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a3ea1-88b1-46f0-90ae-b4c07a096930 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.070457 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a3ea1-88b1-46f0-90ae-b4c07a096930 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.070669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a3ea1-88b1-46f0-90ae-b4c07a096930 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.071351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a3ea1-88b1-46f0-90ae-b4c07a096930 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:04.071654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a3ea1-88b1-46f0-90ae-b4c07a096930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:04.073341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a3ea1-88b1-46f0-90ae-b4c07a096930 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:04.082622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 212/424] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:04.088300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72645c5-6558-48bc-b5e8-685b4d7a2387 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.088513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72645c5-6558-48bc-b5e8-685b4d7a2387 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.088797 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72645c5-6558-48bc-b5e8-685b4d7a2387 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.090024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 213/425] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:04.094665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72645c5-6558-48bc-b5e8-685b4d7a2387 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:04.102194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0081a-820f-492d-834d-c5b1ab95c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:04.102866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0081a-820f-492d-834d-c5b1ab95c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.103151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0081a-820f-492d-834d-c5b1ab95c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.103448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0081a-820f-492d-834d-c5b1ab95c8f7 None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.104564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0081a-820f-492d-834d-c5b1ab95c8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:04.106049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0081a-820f-492d-834d-c5b1ab95c8f7 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:04.108000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 213/426] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:36:03 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:04.114275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1f4c1-68f3-47ad-a63a-0bb4b796cf3d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.114561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1f4c1-68f3-47ad-a63a-0bb4b796cf3d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.114842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1f4c1-68f3-47ad-a63a-0bb4b796cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.134528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3bf1f4c1-68f3-47ad-a63a-0bb4b796cf3d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:04.135744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3bf1f4c1-68f3-47ad-a63a-0bb4b796cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:04.174378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:04.202488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:04.215910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 214/427] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:04.215910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1f4c1-68f3-47ad-a63a-0bb4b796cf3d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:04.246599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72645c5-6558-48bc-b5e8-685b4d7a2387 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:04.318648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbf5c4-bd27-4c08-8eea-3a34fc56fbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:04.319256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbf5c4-bd27-4c08-8eea-3a34fc56fbb4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.319555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbf5c4-bd27-4c08-8eea-3a34fc56fbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.319826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbf5c4-bd27-4c08-8eea-3a34fc56fbb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.413598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1f4c1-68f3-47ad-a63a-0bb4b796cf3d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:04.467147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7355b3-fb02-46ed-9488-5ec8ea8b50b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:04.467918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7355b3-fb02-46ed-9488-5ec8ea8b50b1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.468093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7355b3-fb02-46ed-9488-5ec8ea8b50b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.468360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7355b3-fb02-46ed-9488-5ec8ea8b50b1 None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.469460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7355b3-fb02-46ed-9488-5ec8ea8b50b1 None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:04.470936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7355b3-fb02-46ed-9488-5ec8ea8b50b1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:04.473200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 215/428] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:36:04 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:04.478866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7355b3-fb02-46ed-9488-5ec8ea8b50b1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:04.480282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbf5c4-bd27-4c08-8eea-3a34fc56fbb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:04.481746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbf5c4-bd27-4c08-8eea-3a34fc56fbb4 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:04.526045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:04.604924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7355b3-fb02-46ed-9488-5ec8ea8b50b1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:04.605586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:04.635327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 214/429] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:04.636405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbf5c4-bd27-4c08-8eea-3a34fc56fbb4 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:04.647273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfaa27-1021-4b7e-a0c6-de053826b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:04.648295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfaa27-1021-4b7e-a0c6-de053826b5d0 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.648789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfaa27-1021-4b7e-a0c6-de053826b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.649285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfaa27-1021-4b7e-a0c6-de053826b5d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.650223 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfaa27-1021-4b7e-a0c6-de053826b5d0 None admin] RBAC: Adding query filter params (group.id=d44883f492e642449eccc43bfab70448, role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=5f268518677d45a2953a77368e9f5965) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:04.650746 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfaa27-1021-4b7e-a0c6-de053826b5d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:04.652424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfaa27-1021-4b7e-a0c6-de053826b5d0 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:04.659035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 216/430] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:36:04 2022] GET /identity/v3/role_assignments?group.id=d44883f492e642449eccc43bfab70448&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:04.660682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfaa27-1021-4b7e-a0c6-de053826b5d0 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:04.830736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbf5c4-bd27-4c08-8eea-3a34fc56fbb4 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:04.848024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfaa27-1021-4b7e-a0c6-de053826b5d0 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:04.850733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:04.877632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6e2bc-6bda-4b77-addf-bfdc9efbda0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:04.878255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6e2bc-6bda-4b77-addf-bfdc9efbda0a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.878540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6e2bc-6bda-4b77-addf-bfdc9efbda0a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.879575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6e2bc-6bda-4b77-addf-bfdc9efbda0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.891170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6e2bc-6bda-4b77-addf-bfdc9efbda0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:04.893513 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91c8fb-12fc-4cbf-bb38-73f7aae82c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:04.894301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91c8fb-12fc-4cbf-bb38-73f7aae82c9a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.895140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91c8fb-12fc-4cbf-bb38-73f7aae82c9a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.895430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91c8fb-12fc-4cbf-bb38-73f7aae82c9a None admin] PATH_INFO: `/v3/projects/5f268518677d45a2953a77368e9f5965` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-8ea6e2bc-6bda-4b77-addf-bfdc9efbda0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:04.896538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:04.897375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:36:04.898209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:04.898816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91c8fb-12fc-4cbf-bb38-73f7aae82c9a None admin] RBAC: Authorizing `identity:get_project(project_id=5f268518677d45a2953a77368e9f5965)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:04.898888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 215/431] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:04.898959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91c8fb-12fc-4cbf-bb38-73f7aae82c9a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:04.899029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f4cf2-620d-4cc8-8886-9ca4b5c4c279 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.899029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f4cf2-620d-4cc8-8886-9ca4b5c4c279 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.899951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f4cf2-620d-4cc8-8886-9ca4b5c4c279 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.900634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 216/432] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:04.903968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 217/433] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:36:04 2022] GET /identity/v3/projects/5f268518677d45a2953a77368e9f5965 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:04.905759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fcfec-0364-4323-91be-f6f112b8e556 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:04.906043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fcfec-0364-4323-91be-f6f112b8e556 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:04.906319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fcfec-0364-4323-91be-f6f112b8e556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:04.909156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91c8fb-12fc-4cbf-bb38-73f7aae82c9a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:04.932782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ca6fcfec-0364-4323-91be-f6f112b8e556 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:04.937348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ca6fcfec-0364-4323-91be-f6f112b8e556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:04.984507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:05.032974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 217/434] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:05.039316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fcfec-0364-4323-91be-f6f112b8e556 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:05.058209 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91c8fb-12fc-4cbf-bb38-73f7aae82c9a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:05.103247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8eebc-203b-48c7-9e43-386dc9cc13aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:05.103927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8eebc-203b-48c7-9e43-386dc9cc13aa None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.104212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8eebc-203b-48c7-9e43-386dc9cc13aa None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.104490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8eebc-203b-48c7-9e43-386dc9cc13aa None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.105759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8eebc-203b-48c7-9e43-386dc9cc13aa None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:05.107418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8eebc-203b-48c7-9e43-386dc9cc13aa None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:05.114910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 218/435] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:36:04 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:05.115976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8eebc-203b-48c7-9e43-386dc9cc13aa None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:05.155050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fcfec-0364-4323-91be-f6f112b8e556 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:05.169815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:05.193288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66f9c6-21ca-4048-a493-b8f58b48ccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:05.194287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66f9c6-21ca-4048-a493-b8f58b48ccd1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.194575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66f9c6-21ca-4048-a493-b8f58b48ccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.195103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66f9c6-21ca-4048-a493-b8f58b48ccd1 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.195801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66f9c6-21ca-4048-a493-b8f58b48ccd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:05.196182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66f9c6-21ca-4048-a493-b8f58b48ccd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:05.197715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66f9c6-21ca-4048-a493-b8f58b48ccd1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:05.209684 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 218/436] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:05.216228 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66f9c6-21ca-4048-a493-b8f58b48ccd1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:05.247970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8eebc-203b-48c7-9e43-386dc9cc13aa None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:05.258170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:05.294823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f09258-1798-430f-9184-bee907e1d7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:05.295465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f09258-1798-430f-9184-bee907e1d7fa None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.295753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f09258-1798-430f-9184-bee907e1d7fa None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.296021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f09258-1798-430f-9184-bee907e1d7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.296748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f09258-1798-430f-9184-bee907e1d7fa None admin] RBAC: Adding query filter params (group.id=d44883f492e642449eccc43bfab70448, role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=5f268518677d45a2953a77368e9f5965) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:05.297050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f09258-1798-430f-9184-bee907e1d7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:05.298467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f09258-1798-430f-9184-bee907e1d7fa None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:05.307418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 219/437] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/role_assignments?group.id=d44883f492e642449eccc43bfab70448&scope.project.id=5f268518677d45a2953a77368e9f5965&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:05.308802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78127-e302-471a-8b82-36ea6562555d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.309084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78127-e302-471a-8b82-36ea6562555d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.309366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c78127-e302-471a-8b82-36ea6562555d None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.310802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 220/438] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:05.317636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9321c-d93e-4207-813a-2486126dba56 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.318144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9321c-d93e-4207-813a-2486126dba56 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.318930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9321c-d93e-4207-813a-2486126dba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.343805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66f9c6-21ca-4048-a493-b8f58b48ccd1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:05.344338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ada9321c-d93e-4207-813a-2486126dba56 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:05.346212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ada9321c-d93e-4207-813a-2486126dba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:05.390235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f22ae-356b-4010-9011-1d09265d3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:05.390865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f22ae-356b-4010-9011-1d09265d3b65 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.391120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f22ae-356b-4010-9011-1d09265d3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.391421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f22ae-356b-4010-9011-1d09265d3b65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.435131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 221/439] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:05.448404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9321c-d93e-4207-813a-2486126dba56 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:05.479250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f22ae-356b-4010-9011-1d09265d3b65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:05.480738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f22ae-356b-4010-9011-1d09265d3b65 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:05.497440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:05.519322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:05.587655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9321c-d93e-4207-813a-2486126dba56 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:05.602834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 219/440] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:05.608853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f22ae-356b-4010-9011-1d09265d3b65 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:05.634069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9073dc-ab38-451a-b472-cbf237745993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:05.635069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9073dc-ab38-451a-b472-cbf237745993 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.635733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9073dc-ab38-451a-b472-cbf237745993 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.636225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9073dc-ab38-451a-b472-cbf237745993 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.650501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9073dc-ab38-451a-b472-cbf237745993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-1a9073dc-ab38-451a-b472-cbf237745993 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:05.655760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:05.656646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:05.657707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 222/441] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:05.662876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9073dc-ab38-451a-b472-cbf237745993 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:05.740665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f22ae-356b-4010-9011-1d09265d3b65 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:05.774646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:05.779865 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:05.780701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76cf86-0bad-4424-b711-0944591bb186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:05.781466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76cf86-0bad-4424-b711-0944591bb186 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.786074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76cf86-0bad-4424-b711-0944591bb186 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.786074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76cf86-0bad-4424-b711-0944591bb186 None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.786074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76cf86-0bad-4424-b711-0944591bb186 None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:05.786074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76cf86-0bad-4424-b711-0944591bb186 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:05.787601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 220/442] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:05.787865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76cf86-0bad-4424-b711-0944591bb186 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:05.790528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9073dc-ab38-451a-b472-cbf237745993 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:05.825326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffccfba-73cc-483c-8b95-b57fcc06645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:05.825919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffccfba-73cc-483c-8b95-b57fcc06645d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.826195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffccfba-73cc-483c-8b95-b57fcc06645d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.826471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffccfba-73cc-483c-8b95-b57fcc06645d None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.827126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffccfba-73cc-483c-8b95-b57fcc06645d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:05.827472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffccfba-73cc-483c-8b95-b57fcc06645d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:05.828840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffccfba-73cc-483c-8b95-b57fcc06645d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:05.837322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 223/443] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:05.838106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffccfba-73cc-483c-8b95-b57fcc06645d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:05.888387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76cf86-0bad-4424-b711-0944591bb186 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:05.921023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfe562-302a-4674-b6bf-b6a6889c3c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:05.923471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfe562-302a-4674-b6bf-b6a6889c3c85 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.923471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfe562-302a-4674-b6bf-b6a6889c3c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.923471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfe562-302a-4674-b6bf-b6a6889c3c85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.933240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfe562-302a-4674-b6bf-b6a6889c3c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-41cfe562-302a-4674-b6bf-b6a6889c3c85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:05.938409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:05.939342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 221/444] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:05.945865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfe562-302a-4674-b6bf-b6a6889c3c85 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:05.946666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffccfba-73cc-483c-8b95-b57fcc06645d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:05.978527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af4036-46aa-405d-b77a-5e2b4c3eebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:05.979153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af4036-46aa-405d-b77a-5e2b4c3eebb9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:05.979465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af4036-46aa-405d-b77a-5e2b4c3eebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:05.979742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af4036-46aa-405d-b77a-5e2b4c3eebb9 None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:05.980879 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af4036-46aa-405d-b77a-5e2b4c3eebb9 None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:05.982315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af4036-46aa-405d-b77a-5e2b4c3eebb9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:05.983909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 224/445] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:05.984671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af4036-46aa-405d-b77a-5e2b4c3eebb9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:06.001324 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:06.012232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:06.042229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfe562-302a-4674-b6bf-b6a6889c3c85 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:06.078490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05652cbd-380a-41ec-93b7-0e5a3f146509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:06.079086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05652cbd-380a-41ec-93b7-0e5a3f146509 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:06.079392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05652cbd-380a-41ec-93b7-0e5a3f146509 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:06.079673 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05652cbd-380a-41ec-93b7-0e5a3f146509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:06.088021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af4036-46aa-405d-b77a-5e2b4c3eebb9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:06.122389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e64052-b2a4-4a0c-baf9-3bce13d2bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:06.122993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e64052-b2a4-4a0c-baf9-3bce13d2bc06 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:06.123279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e64052-b2a4-4a0c-baf9-3bce13d2bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:06.123578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e64052-b2a4-4a0c-baf9-3bce13d2bc06 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:06.124238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e64052-b2a4-4a0c-baf9-3bce13d2bc06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:06.124550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e64052-b2a4-4a0c-baf9-3bce13d2bc06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:06.125905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e64052-b2a4-4a0c-baf9-3bce13d2bc06 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:06.138980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 225/446] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:06.138980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e64052-b2a4-4a0c-baf9-3bce13d2bc06 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:06.147683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05652cbd-380a-41ec-93b7-0e5a3f146509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:06.149164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05652cbd-380a-41ec-93b7-0e5a3f146509 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:06.206653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:06.223878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:06.239044 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e64052-b2a4-4a0c-baf9-3bce13d2bc06 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:06.250336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 222/447] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:06.251172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05652cbd-380a-41ec-93b7-0e5a3f146509 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:06.277587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50852b-5d43-4dea-abac-fce1e77691fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:06.278190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50852b-5d43-4dea-abac-fce1e77691fe None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:06.278476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50852b-5d43-4dea-abac-fce1e77691fe None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:06.278755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50852b-5d43-4dea-abac-fce1e77691fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:06.279507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50852b-5d43-4dea-abac-fce1e77691fe None admin] RBAC: Adding query filter params (group.id=d44883f492e642449eccc43bfab70448, role.id=2b1ba082ef764b35bc85187a263a9016, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:06.279816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50852b-5d43-4dea-abac-fce1e77691fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:06.281263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50852b-5d43-4dea-abac-fce1e77691fe None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:06.287348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 226/448] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:36:06 2022] GET /identity/v3/role_assignments?group.id=d44883f492e642449eccc43bfab70448&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=2b1ba082ef764b35bc85187a263a9016 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:06.288139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50852b-5d43-4dea-abac-fce1e77691fe None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:06.366872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05652cbd-380a-41ec-93b7-0e5a3f146509 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:06.405659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ba88-d693-4af4-b5bc-3387ca6cf553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:06.406191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ba88-d693-4af4-b5bc-3387ca6cf553 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:06.406481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ba88-d693-4af4-b5bc-3387ca6cf553 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:06.406754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ba88-d693-4af4-b5bc-3387ca6cf553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:06.421205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50852b-5d43-4dea-abac-fce1e77691fe None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:06.445234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:06.461475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aaa29-cf8e-4171-918a-d61d994c531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:06.462109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aaa29-cf8e-4171-918a-d61d994c531b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:06.462386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aaa29-cf8e-4171-918a-d61d994c531b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:06.462654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aaa29-cf8e-4171-918a-d61d994c531b None admin] PATH_INFO: `/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:06.464573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9aaa29-cf8e-4171-918a-d61d994c531b None admin] RBAC: Authorizing `identity:get_project(project_id=d4f53e5afc1d4015a10f92f1b6923fab)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:06.466036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9aaa29-cf8e-4171-918a-d61d994c531b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:06.467912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 227/449] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:36:06 2022] GET /identity/v3/projects/d4f53e5afc1d4015a10f92f1b6923fab => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:06.476277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aaa29-cf8e-4171-918a-d61d994c531b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:06.493944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ba88-d693-4af4-b5bc-3387ca6cf553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:06.495490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ba88-d693-4af4-b5bc-3387ca6cf553 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:06.501258 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:06.601973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aaa29-cf8e-4171-918a-d61d994c531b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:06.614072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 223/450] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:06.619947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ba88-d693-4af4-b5bc-3387ca6cf553 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:06.649159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea24f9-42c9-44dc-afa5-ac99a101343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:06.650041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea24f9-42c9-44dc-afa5-ac99a101343a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:06.650316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea24f9-42c9-44dc-afa5-ac99a101343a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:06.650590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea24f9-42c9-44dc-afa5-ac99a101343a None admin] PATH_INFO: `/v3/groups/d44883f492e642449eccc43bfab70448` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:06.655110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea24f9-42c9-44dc-afa5-ac99a101343a None admin] RBAC: Authorizing `identity:get_group(group_id=d44883f492e642449eccc43bfab70448)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:06.655825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea24f9-42c9-44dc-afa5-ac99a101343a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:06.658399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 228/451] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:36:06 2022] GET /identity/v3/groups/d44883f492e642449eccc43bfab70448 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:06.667238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea24f9-42c9-44dc-afa5-ac99a101343a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:06.707780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:06.775841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ba88-d693-4af4-b5bc-3387ca6cf553 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:06.783145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:06.798454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea24f9-42c9-44dc-afa5-ac99a101343a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:06.810409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16f23a-a1a6-44a3-b093-9f4019acfa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:06.811035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16f23a-a1a6-44a3-b093-9f4019acfa94 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:06.811340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16f23a-a1a6-44a3-b093-9f4019acfa94 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:06.811621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16f23a-a1a6-44a3-b093-9f4019acfa94 None admin] PATH_INFO: `/v3/projects/0aa975bb77094d52bcdbb2bd261327d8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:06.812751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16f23a-a1a6-44a3-b093-9f4019acfa94 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa975bb77094d52bcdbb2bd261327d8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:06.814180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16f23a-a1a6-44a3-b093-9f4019acfa94 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:06.816151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 224/452] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:36:06 2022] GET /identity/v3/projects/0aa975bb77094d52bcdbb2bd261327d8 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:06.821237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16f23a-a1a6-44a3-b093-9f4019acfa94 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:06.835325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d95e01-dfe4-48f6-aaa5-d702fa008910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:06.835934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d95e01-dfe4-48f6-aaa5-d702fa008910 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:06.836221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d95e01-dfe4-48f6-aaa5-d702fa008910 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:06.836498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d95e01-dfe4-48f6-aaa5-d702fa008910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:06.837210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d95e01-dfe4-48f6-aaa5-d702fa008910 None admin] RBAC: Adding query filter params (group.id=d44883f492e642449eccc43bfab70448, role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:06.837516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d95e01-dfe4-48f6-aaa5-d702fa008910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:06.838927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d95e01-dfe4-48f6-aaa5-d702fa008910 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:06.844792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 229/453] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:36:06 2022] GET /identity/v3/role_assignments?group.id=d44883f492e642449eccc43bfab70448&scope.project.id=d4f53e5afc1d4015a10f92f1b6923fab&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:06.933842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16f23a-a1a6-44a3-b093-9f4019acfa94 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:06.962472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:06.970143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb236eb2-e523-4eef-9654-bba7384c3569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:06.970776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb236eb2-e523-4eef-9654-bba7384c3569 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:06.971054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb236eb2-e523-4eef-9654-bba7384c3569 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:06.971350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb236eb2-e523-4eef-9654-bba7384c3569 None admin] PATH_INFO: `/v3/groups/127bf94cc71b42029536ad447dcf0ab0` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:06.972718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb236eb2-e523-4eef-9654-bba7384c3569 None admin] RBAC: Authorizing `identity:get_group(group_id=127bf94cc71b42029536ad447dcf0ab0)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:06.974250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb236eb2-e523-4eef-9654-bba7384c3569 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:06.975930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 225/454] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 24 07:36:06 2022] GET /identity/v3/groups/127bf94cc71b42029536ad447dcf0ab0 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:06.981870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d95e01-dfe4-48f6-aaa5-d702fa008910 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:07.087541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d95e01-dfe4-48f6-aaa5-d702fa008910 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:07.124145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67e420-bd2f-428b-9113-95ea576eab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:07.124760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67e420-bd2f-428b-9113-95ea576eab65 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:07.125048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67e420-bd2f-428b-9113-95ea576eab65 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:07.125326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67e420-bd2f-428b-9113-95ea576eab65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:07.126059 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67e420-bd2f-428b-9113-95ea576eab65 None admin] RBAC: Adding query filter params (group.id=127bf94cc71b42029536ad447dcf0ab0, role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=0aa975bb77094d52bcdbb2bd261327d8) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:07.126378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67e420-bd2f-428b-9113-95ea576eab65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:07.127938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67e420-bd2f-428b-9113-95ea576eab65 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:07.134141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 230/455] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 24 07:36:06 2022] GET /identity/v3/role_assignments?group.id=127bf94cc71b42029536ad447dcf0ab0&scope.project.id=0aa975bb77094d52bcdbb2bd261327d8&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:09.554576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0065a-ad7e-4c2c-a1ce-aa6ce9eb15b8 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:09.555100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0065a-ad7e-4c2c-a1ce-aa6ce9eb15b8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:09.555100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0065a-ad7e-4c2c-a1ce-aa6ce9eb15b8 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:09.556668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 226/456] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:09.573325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b74dd4-161b-4a93-a5cb-23b47b12b222 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:09.573854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b74dd4-161b-4a93-a5cb-23b47b12b222 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:09.573854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b74dd4-161b-4a93-a5cb-23b47b12b222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:09.611482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d6b74dd4-161b-4a93-a5cb-23b47b12b222 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:09.611482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d6b74dd4-161b-4a93-a5cb-23b47b12b222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:09.631657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:09.773901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 231/457] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:09.877127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc024d0-ed3b-4569-b016-32fdf4366a47 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:09.877311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc024d0-ed3b-4569-b016-32fdf4366a47 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:09.877584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc024d0-ed3b-4569-b016-32fdf4366a47 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:09.879001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 227/458] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:09.884412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd607c2-9ac5-4669-b42b-7b978bd87651 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:09.884699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd607c2-9ac5-4669-b42b-7b978bd87651 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:09.884973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd607c2-9ac5-4669-b42b-7b978bd87651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:09.903037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cc2c4-001a-43e3-ba36-2a32f0b00d99 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:09.903393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cc2c4-001a-43e3-ba36-2a32f0b00d99 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:09.903623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cc2c4-001a-43e3-ba36-2a32f0b00d99 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:09.904909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-edd607c2-9ac5-4669-b42b-7b978bd87651 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:09.905436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 228/459] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:09.906157 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-edd607c2-9ac5-4669-b42b-7b978bd87651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:09.919392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786c37-3c80-4412-8493-4671b9ed912d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:09.922852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786c37-3c80-4412-8493-4671b9ed912d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:09.922852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786c37-3c80-4412-8493-4671b9ed912d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:09.956648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-a6786c37-3c80-4412-8493-4671b9ed912d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:09.958048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a6786c37-3c80-4412-8493-4671b9ed912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:10.062319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 232/460] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:10.076159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 229/461] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:10.235662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd607c2-9ac5-4669-b42b-7b978bd87651 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:10.274768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798fb70-48f5-4016-b41a-28ebc3d874a9 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:10.275076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798fb70-48f5-4016-b41a-28ebc3d874a9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:10.275345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798fb70-48f5-4016-b41a-28ebc3d874a9 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:10.276824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 230/462] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:36:10.289322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409be78-0290-4a40-ac74-e20cf65f7132 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:10.289608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409be78-0290-4a40-ac74-e20cf65f7132 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:10.289885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409be78-0290-4a40-ac74-e20cf65f7132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:10.322960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1409be78-0290-4a40-ac74-e20cf65f7132 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:10.324332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1409be78-0290-4a40-ac74-e20cf65f7132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:10.393509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:10.421895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 231/463] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:10.422074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd607c2-9ac5-4669-b42b-7b978bd87651 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:10.422569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409be78-0290-4a40-ac74-e20cf65f7132 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:10.466500 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de79a4-74b3-45ca-bdb6-6f76ab57c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:10.467977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de79a4-74b3-45ca-bdb6-6f76ab57c308 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:10.468270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de79a4-74b3-45ca-bdb6-6f76ab57c308 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:10.468543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de79a4-74b3-45ca-bdb6-6f76ab57c308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:10.484427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de79a4-74b3-45ca-bdb6-6f76ab57c308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:10.486239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de79a4-74b3-45ca-bdb6-6f76ab57c308 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:10.491790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-e2de79a4-74b3-45ca-bdb6-6f76ab57c308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:10.507988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:10.508914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:10.509771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:10.509771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:10.509771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:10.517045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 233/464] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:10.517045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de79a4-74b3-45ca-bdb6-6f76ab57c308 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:10.546403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409be78-0290-4a40-ac74-e20cf65f7132 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:10.589469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd8568-d9af-437f-a058-a4b13bd6ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:10.590087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd8568-d9af-437f-a058-a4b13bd6ca5d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:10.590398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd8568-d9af-437f-a058-a4b13bd6ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:10.590695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd8568-d9af-437f-a058-a4b13bd6ca5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:10.602549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd8568-d9af-437f-a058-a4b13bd6ca5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:10.604039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd8568-d9af-437f-a058-a4b13bd6ca5d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-2bdd8568-d9af-437f-a058-a4b13bd6ca5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:10.620929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:10.621858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:10.622759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:10.622759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:10.622759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:10.626948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 232/465] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:10.627986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd8568-d9af-437f-a058-a4b13bd6ca5d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:10.642235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de79a4-74b3-45ca-bdb6-6f76ab57c308 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:10.679466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:10.692421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6412333-836f-4b80-8034-2f952ddc190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:10.693328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6412333-836f-4b80-8034-2f952ddc190c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:10.695103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6412333-836f-4b80-8034-2f952ddc190c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:10.695103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6412333-836f-4b80-8034-2f952ddc190c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:10.707156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6412333-836f-4b80-8034-2f952ddc190c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:10.709921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6412333-836f-4b80-8034-2f952ddc190c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-a6412333-836f-4b80-8034-2f952ddc190c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:10.726608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:10.727566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:10.728402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:10.728402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:10.728402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:10.728402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 234/466] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:10.728610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6412333-836f-4b80-8034-2f952ddc190c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:10.746921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd8568-d9af-437f-a058-a4b13bd6ca5d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:10.756736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:10.783062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fc534-2ec7-4b55-a1c5-1c9582f84995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:10.783811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fc534-2ec7-4b55-a1c5-1c9582f84995 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:10.784118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fc534-2ec7-4b55-a1c5-1c9582f84995 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:10.785107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fc534-2ec7-4b55-a1c5-1c9582f84995 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:10.785892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fc534-2ec7-4b55-a1c5-1c9582f84995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:10.786549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fc534-2ec7-4b55-a1c5-1c9582f84995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:10.788011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fc534-2ec7-4b55-a1c5-1c9582f84995 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:10.802191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 233/467] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:10.802191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fc534-2ec7-4b55-a1c5-1c9582f84995 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:10.853647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6412333-836f-4b80-8034-2f952ddc190c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:10.892187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d478450-62d2-45b5-862d-0a1694be6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:10.893086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d478450-62d2-45b5-862d-0a1694be6063 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:10.893554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d478450-62d2-45b5-862d-0a1694be6063 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:10.894087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d478450-62d2-45b5-862d-0a1694be6063 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:10.894988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d478450-62d2-45b5-862d-0a1694be6063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:10.895194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d478450-62d2-45b5-862d-0a1694be6063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:10.896614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d478450-62d2-45b5-862d-0a1694be6063 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:10.911171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fc534-2ec7-4b55-a1c5-1c9582f84995 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:10.920565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 235/468] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:10.920565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d478450-62d2-45b5-862d-0a1694be6063 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:10.951589 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3c790-3044-4491-ad78-2a91ab6c4b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:10.952241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3c790-3044-4491-ad78-2a91ab6c4b28 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:10.952521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3c790-3044-4491-ad78-2a91ab6c4b28 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:10.952791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3c790-3044-4491-ad78-2a91ab6c4b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:10.962391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:10.963459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3c790-3044-4491-ad78-2a91ab6c4b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:10.964984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3c790-3044-4491-ad78-2a91ab6c4b28 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-29e3c790-3044-4491-ad78-2a91ab6c4b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:10.980528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:10.981540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:10.982371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:10.982371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:10.982371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:10.982371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 234/469] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:10.982371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3c790-3044-4491-ad78-2a91ab6c4b28 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:11.009139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:11.032923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d478450-62d2-45b5-862d-0a1694be6063 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:11.070610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cffd08-b9bc-431e-baa0-34d39ff208c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:11.071222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cffd08-b9bc-431e-baa0-34d39ff208c4 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:11.071525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cffd08-b9bc-431e-baa0-34d39ff208c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:11.071802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cffd08-b9bc-431e-baa0-34d39ff208c4 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:11.072445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cffd08-b9bc-431e-baa0-34d39ff208c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:11.072755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cffd08-b9bc-431e-baa0-34d39ff208c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:11.074142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cffd08-b9bc-431e-baa0-34d39ff208c4 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:11.086124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 236/470] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:11.086896 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cffd08-b9bc-431e-baa0-34d39ff208c4 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:11.106194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3c790-3044-4491-ad78-2a91ab6c4b28 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:11.142864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6d777-e13c-4c39-a6b5-2235ef82b9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:11.143497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6d777-e13c-4c39-a6b5-2235ef82b9dd None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:11.144291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6d777-e13c-4c39-a6b5-2235ef82b9dd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:11.144567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6d777-e13c-4c39-a6b5-2235ef82b9dd None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:11.145201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6d777-e13c-4c39-a6b5-2235ef82b9dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:11.146696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6d777-e13c-4c39-a6b5-2235ef82b9dd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:11.189181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:11.193837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cffd08-b9bc-431e-baa0-34d39ff208c4 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:11.225127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 235/471] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:36:10 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:11.226048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6d777-e13c-4c39-a6b5-2235ef82b9dd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:11.226545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2d7f7-40d4-4878-8702-a9d047637e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:11.227159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2d7f7-40d4-4878-8702-a9d047637e01 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:11.227476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2d7f7-40d4-4878-8702-a9d047637e01 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:11.227757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2d7f7-40d4-4878-8702-a9d047637e01 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:11.228405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2d7f7-40d4-4878-8702-a9d047637e01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:11.229905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2d7f7-40d4-4878-8702-a9d047637e01 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:11.312181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:11.321759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 237/472] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:36:11 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:11.322914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2d7f7-40d4-4878-8702-a9d047637e01 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:11.348528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6d777-e13c-4c39-a6b5-2235ef82b9dd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:11.396605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4f55b-35b4-42e6-bde2-fa8cf35b4fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:11.397078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f55b-35b4-42e6-bde2-fa8cf35b4fda None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:11.397440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f55b-35b4-42e6-bde2-fa8cf35b4fda None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:11.397791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f55b-35b4-42e6-bde2-fa8cf35b4fda None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:11.398472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4f55b-35b4-42e6-bde2-fa8cf35b4fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:11.398781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4f55b-35b4-42e6-bde2-fa8cf35b4fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:11.400237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4f55b-35b4-42e6-bde2-fa8cf35b4fda None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:11.417225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 236/473] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:11.418599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da77c2-78b1-4c90-8fdf-a8af552cb73f None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:11.419132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da77c2-78b1-4c90-8fdf-a8af552cb73f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:11.419132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da77c2-78b1-4c90-8fdf-a8af552cb73f None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:11.420542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 237/474] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:11.427224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da77c2-78b1-4c90-8fdf-a8af552cb73f None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:11.513739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2d7f7-40d4-4878-8702-a9d047637e01 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:11.556079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f39c8-eed2-4d1c-9c8a-40706f7c2519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:11.556862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f39c8-eed2-4d1c-9c8a-40706f7c2519 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:11.557246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f39c8-eed2-4d1c-9c8a-40706f7c2519 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:11.557728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f39c8-eed2-4d1c-9c8a-40706f7c2519 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:11.559037 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f39c8-eed2-4d1c-9c8a-40706f7c2519 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:11.560163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f39c8-eed2-4d1c-9c8a-40706f7c2519 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:11.566515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da77c2-78b1-4c90-8fdf-a8af552cb73f None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:11.603682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec014150-b212-409f-b184-98c4ea5b6045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:11.604310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014150-b212-409f-b184-98c4ea5b6045 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:11.604552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014150-b212-409f-b184-98c4ea5b6045 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:11.604838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014150-b212-409f-b184-98c4ea5b6045 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:11.605483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec014150-b212-409f-b184-98c4ea5b6045 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:11.606919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec014150-b212-409f-b184-98c4ea5b6045 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:11.617196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:11.653090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 238/475] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:36:11 2022] POST /identity/v3/users => generated 246 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:11.659965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa961-aeec-48b5-8874-0012ad5a9341 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:11.659965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa961-aeec-48b5-8874-0012ad5a9341 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:11.659965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa961-aeec-48b5-8874-0012ad5a9341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:11.678786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3a4fa961-aeec-48b5-8874-0012ad5a9341 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:11.680378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3a4fa961-aeec-48b5-8874-0012ad5a9341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:11.684123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:11.758215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 238/476] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:36:11 2022] POST /identity/v3/users => generated 249 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:11.774399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 239/477] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:12.060279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec014150-b212-409f-b184-98c4ea5b6045 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:12.171984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec014150-b212-409f-b184-98c4ea5b6045 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:12.213485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:12.214325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:12.214778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:12.215192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:12.216077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:12.217580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:12.276856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.sql.core [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:36:12.276856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 07:36:12.276856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [parameters: {'id': '2c78b1cf100342ad8f777493450116b6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 07:36:12.276856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88252) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application result.read() Aug 24 07:36:12.294489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:36:12.295621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application yield resource Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise self.value Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application session.commit() Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:36:12.296791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:36:12.297873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:36:12.298942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application result.read() Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:36:12.300183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [parameters: {'id': '2c78b1cf100342ad8f777493450116b6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:12.301329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 07:36:12.302105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:12.304959 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 239/478] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 07:36:12 2022] POST /identity/v3/roles => generated 144 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:12.312679 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa961-aeec-48b5-8874-0012ad5a9341 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:12.455835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa961-aeec-48b5-8874-0012ad5a9341 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:12.512621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02840ba-4329-40ad-aa68-daa7fa002244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:12.513270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02840ba-4329-40ad-aa68-daa7fa002244 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:12.513551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02840ba-4329-40ad-aa68-daa7fa002244 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:12.513824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02840ba-4329-40ad-aa68-daa7fa002244 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:12.525913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:12.528778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02840ba-4329-40ad-aa68-daa7fa002244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-e02840ba-4329-40ad-aa68-daa7fa002244 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:12.533766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:12.535388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:36:12.536377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:12.539316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 240/479] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:12.542851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:12.671969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:12.728934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7056-b753-4b52-8468-66c16468b968 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:12.775818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca189dd-3773-4ff1-bad0-085695530e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:12.776418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca189dd-3773-4ff1-bad0-085695530e83 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:12.776695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca189dd-3773-4ff1-bad0-085695530e83 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:12.776961 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca189dd-3773-4ff1-bad0-085695530e83 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:12.777619 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca189dd-3773-4ff1-bad0-085695530e83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:12.777916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca189dd-3773-4ff1-bad0-085695530e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:12.779270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca189dd-3773-4ff1-bad0-085695530e83 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:12.787983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 240/480] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:13.484946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfa966-4de9-4a9a-965f-e0161d11e614 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:13.485464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfa966-4de9-4a9a-965f-e0161d11e614 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:13.485464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfa966-4de9-4a9a-965f-e0161d11e614 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:13.488086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 241/481] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:13.497098 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f247-8c92-46dc-908f-34886e55ae71 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:13.497611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f247-8c92-46dc-908f-34886e55ae71 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:13.498112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f247-8c92-46dc-908f-34886e55ae71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:13.531565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-6100f247-8c92-46dc-908f-34886e55ae71 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:13.532763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6100f247-8c92-46dc-908f-34886e55ae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:13.625971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 241/482] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:13.677966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d21eb-6aa8-4f70-a5ed-d2422f703eab None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:13.678272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d21eb-6aa8-4f70-a5ed-d2422f703eab None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:13.678517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d21eb-6aa8-4f70-a5ed-d2422f703eab None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:13.680709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 242/483] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:13.686309 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201e64-bd87-4621-9479-172ad4df8865 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:13.686770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201e64-bd87-4621-9479-172ad4df8865 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:13.686949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201e64-bd87-4621-9479-172ad4df8865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:13.712105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-47201e64-bd87-4621-9479-172ad4df8865 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:13.713303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-47201e64-bd87-4621-9479-172ad4df8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:13.759768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:13.782605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 242/484] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:14.000627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d21eb-6aa8-4f70-a5ed-d2422f703eab None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:14.140943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d21eb-6aa8-4f70-a5ed-d2422f703eab None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:14.169300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d5ed6-a5fe-45eb-8911-d5f640ecce71 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.169610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d5ed6-a5fe-45eb-8911-d5f640ecce71 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.169844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d5ed6-a5fe-45eb-8911-d5f640ecce71 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.171462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 243/485] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:36:14.177152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8f81b-3266-4c91-b873-cefdb3751645 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.177685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8f81b-3266-4c91-b873-cefdb3751645 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.177954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8f81b-3266-4c91-b873-cefdb3751645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.193030 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bae43-05c4-4397-80f2-1975714bdeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:14.194010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bae43-05c4-4397-80f2-1975714bdeb7 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.194462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bae43-05c4-4397-80f2-1975714bdeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.194912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bae43-05c4-4397-80f2-1975714bdeb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.199059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-49c8f81b-3266-4c91-b873-cefdb3751645 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:14.200538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-49c8f81b-3266-4c91-b873-cefdb3751645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:14.206620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5bae43-05c4-4397-80f2-1975714bdeb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-fc5bae43-05c4-4397-80f2-1975714bdeb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:14.211876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:14.212741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:14.213537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:14.220253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 243/486] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:14.220377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bae43-05c4-4397-80f2-1975714bdeb7 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:14.280243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 244/487] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:14.281011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8f81b-3266-4c91-b873-cefdb3751645 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:14.289656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:14.342732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bae43-05c4-4397-80f2-1975714bdeb7 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:14.387263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5080d-69b9-49b6-8662-5d6cac3c348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:14.387930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5080d-69b9-49b6-8662-5d6cac3c348a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.388206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5080d-69b9-49b6-8662-5d6cac3c348a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.388475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5080d-69b9-49b6-8662-5d6cac3c348a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.400062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5080d-69b9-49b6-8662-5d6cac3c348a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:14.403843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8f81b-3266-4c91-b873-cefdb3751645 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-69d5080d-69b9-49b6-8662-5d6cac3c348a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:14.404885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:14.405736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 244/488] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:14.410292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c3aa1-ca48-421a-a404-de078534a379 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.412560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c3aa1-ca48-421a-a404-de078534a379 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.412560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c3aa1-ca48-421a-a404-de078534a379 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.412560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 245/489] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:14.415537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14397563-8a12-4a6d-812e-e90a59858d2f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.415537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14397563-8a12-4a6d-812e-e90a59858d2f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.415537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14397563-8a12-4a6d-812e-e90a59858d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.423885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:14.435016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-14397563-8a12-4a6d-812e-e90a59858d2f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:14.440527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-14397563-8a12-4a6d-812e-e90a59858d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:14.451184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569de74-c236-4371-8744-b4cf4bf02d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:14.452240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569de74-c236-4371-8744-b4cf4bf02d25 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.452744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569de74-c236-4371-8744-b4cf4bf02d25 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.453258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569de74-c236-4371-8744-b4cf4bf02d25 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.454256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569de74-c236-4371-8744-b4cf4bf02d25 None admin] RBAC: Adding query filter params (name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:14.454778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569de74-c236-4371-8744-b4cf4bf02d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:14.456587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569de74-c236-4371-8744-b4cf4bf02d25 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:14.470580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 245/490] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:14.472480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569de74-c236-4371-8744-b4cf4bf02d25 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:14.506607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 246/491] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:14.507505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14397563-8a12-4a6d-812e-e90a59858d2f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:14.593452 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:14.598207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569de74-c236-4371-8744-b4cf4bf02d25 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:14.646153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae2e9c-3551-4e38-a801-0ff9a221b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:14.647595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae2e9c-3551-4e38-a801-0ff9a221b0e6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.648291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae2e9c-3551-4e38-a801-0ff9a221b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.648713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae2e9c-3551-4e38-a801-0ff9a221b0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.649837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae2e9c-3551-4e38-a801-0ff9a221b0e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:14.650689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae2e9c-3551-4e38-a801-0ff9a221b0e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:14.652502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae2e9c-3551-4e38-a801-0ff9a221b0e6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:14.653247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14397563-8a12-4a6d-812e-e90a59858d2f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:14.668492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 246/492] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:14.668492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae2e9c-3551-4e38-a801-0ff9a221b0e6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:14.704675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76032d-3205-400a-a288-3001ed2a1c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:14.706073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:14.707749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76032d-3205-400a-a288-3001ed2a1c34 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.708262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76032d-3205-400a-a288-3001ed2a1c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.708744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76032d-3205-400a-a288-3001ed2a1c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.723127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76032d-3205-400a-a288-3001ed2a1c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:14.725536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76032d-3205-400a-a288-3001ed2a1c34 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-9a76032d-3205-400a-a288-3001ed2a1c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:14.744435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:14.745339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:14.746187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:14.746187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:14.746187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:14.754067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 247/493] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:14.755128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76032d-3205-400a-a288-3001ed2a1c34 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:14.786616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae2e9c-3551-4e38-a801-0ff9a221b0e6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:14.828653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527f44a-0e05-4b54-a8df-26138ae51ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:14.829291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527f44a-0e05-4b54-a8df-26138ae51ee8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.829581 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527f44a-0e05-4b54-a8df-26138ae51ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.829852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527f44a-0e05-4b54-a8df-26138ae51ee8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.841844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527f44a-0e05-4b54-a8df-26138ae51ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-d527f44a-0e05-4b54-a8df-26138ae51ee8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:14.855133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:14.857126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 247/494] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:14.858723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527f44a-0e05-4b54-a8df-26138ae51ee8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:14.885640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76032d-3205-400a-a288-3001ed2a1c34 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:14.887700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:14.922775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba46b1-a79b-4a6b-81f5-a8f89940ebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:14.923455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba46b1-a79b-4a6b-81f5-a8f89940ebc2 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:14.923775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba46b1-a79b-4a6b-81f5-a8f89940ebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:14.924060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba46b1-a79b-4a6b-81f5-a8f89940ebc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:14.938141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba46b1-a79b-4a6b-81f5-a8f89940ebc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:14.939800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba46b1-a79b-4a6b-81f5-a8f89940ebc2 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-23ba46b1-a79b-4a6b-81f5-a8f89940ebc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:14.955672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:14.956761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:14.963127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:14.963127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:14.963127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:14.963127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 248/495] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:14.963127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba46b1-a79b-4a6b-81f5-a8f89940ebc2 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:14.974194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:14.987076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527f44a-0e05-4b54-a8df-26138ae51ee8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.029405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb1c7-e0c4-4eac-a192-3824979ca7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.030025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb1c7-e0c4-4eac-a192-3824979ca7b2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.030303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb1c7-e0c4-4eac-a192-3824979ca7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.030629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb1c7-e0c4-4eac-a192-3824979ca7b2 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.031854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cb1c7-e0c4-4eac-a192-3824979ca7b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:15.032331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cb1c7-e0c4-4eac-a192-3824979ca7b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:15.033716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cb1c7-e0c4-4eac-a192-3824979ca7b2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:15.047195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 248/496] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:15.048371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb1c7-e0c4-4eac-a192-3824979ca7b2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.093122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba46b1-a79b-4a6b-81f5-a8f89940ebc2 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.138562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce66d0-85c6-4e02-b850-3c2dbe4e791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.139123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce66d0-85c6-4e02-b850-3c2dbe4e791b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.139433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce66d0-85c6-4e02-b850-3c2dbe4e791b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.139708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce66d0-85c6-4e02-b850-3c2dbe4e791b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.151675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce66d0-85c6-4e02-b850-3c2dbe4e791b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-6cce66d0-85c6-4e02-b850-3c2dbe4e791b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:15.157640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:15.158543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 249/497] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:15.164322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce66d0-85c6-4e02-b850-3c2dbe4e791b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.165205 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb1c7-e0c4-4eac-a192-3824979ca7b2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.188110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:15.200211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c0c07-1ccd-441d-b149-3bffa13a4e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.200821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c0c07-1ccd-441d-b149-3bffa13a4e1b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.201103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c0c07-1ccd-441d-b149-3bffa13a4e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.201384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c0c07-1ccd-441d-b149-3bffa13a4e1b None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.202052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c0c07-1ccd-441d-b149-3bffa13a4e1b None admin] RBAC: Adding query filter params (name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:15.202359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c0c07-1ccd-441d-b149-3bffa13a4e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:15.204048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c0c07-1ccd-441d-b149-3bffa13a4e1b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:15.217229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 249/498] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:15.217229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c0c07-1ccd-441d-b149-3bffa13a4e1b None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.236152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:15.292934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce66d0-85c6-4e02-b850-3c2dbe4e791b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.349877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9ca55-e4c5-4e86-b725-376a1297b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.350622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9ca55-e4c5-4e86-b725-376a1297b3ad None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.351110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9ca55-e4c5-4e86-b725-376a1297b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.351536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c0c07-1ccd-441d-b149-3bffa13a4e1b None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.351701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9ca55-e4c5-4e86-b725-376a1297b3ad None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.352534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9ca55-e4c5-4e86-b725-376a1297b3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:15.352842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9ca55-e4c5-4e86-b725-376a1297b3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:15.354806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9ca55-e4c5-4e86-b725-376a1297b3ad None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:15.377180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 250/499] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:15.378159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9ca55-e4c5-4e86-b725-376a1297b3ad None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.412423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23250f4c-70a6-48f1-ac1f-b923c19e9295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.413396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23250f4c-70a6-48f1-ac1f-b923c19e9295 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.413867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23250f4c-70a6-48f1-ac1f-b923c19e9295 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.414432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23250f4c-70a6-48f1-ac1f-b923c19e9295 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.426757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23250f4c-70a6-48f1-ac1f-b923c19e9295 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:15.429309 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23250f4c-70a6-48f1-ac1f-b923c19e9295 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-23250f4c-70a6-48f1-ac1f-b923c19e9295 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:15.448611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:15.449579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:15.450471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 250/500] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:15.451029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23250f4c-70a6-48f1-ac1f-b923c19e9295 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.470038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:15.496419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9ca55-e4c5-4e86-b725-376a1297b3ad None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.531341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51acab-0fe6-481b-a8b8-bb89c05917d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.531986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51acab-0fe6-481b-a8b8-bb89c05917d8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.532218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51acab-0fe6-481b-a8b8-bb89c05917d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.533302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51acab-0fe6-481b-a8b8-bb89c05917d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.533302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51acab-0fe6-481b-a8b8-bb89c05917d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:15.533615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51acab-0fe6-481b-a8b8-bb89c05917d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:15.535906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51acab-0fe6-481b-a8b8-bb89c05917d8 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:15.542468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:15.546979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 251/501] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:15.547733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51acab-0fe6-481b-a8b8-bb89c05917d8 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.573830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23250f4c-70a6-48f1-ac1f-b923c19e9295 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.613175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add28e5-4ae5-45df-b722-818ca99be340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.613796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add28e5-4ae5-45df-b722-818ca99be340 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.614078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add28e5-4ae5-45df-b722-818ca99be340 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.614351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add28e5-4ae5-45df-b722-818ca99be340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.625282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add28e5-4ae5-45df-b722-818ca99be340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:15.626732 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add28e5-4ae5-45df-b722-818ca99be340 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-5add28e5-4ae5-45df-b722-818ca99be340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:15.642335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:15.643820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:15.644675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:15.644675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:15.644675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:15.644843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 251/502] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:15.645584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add28e5-4ae5-45df-b722-818ca99be340 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.675660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51acab-0fe6-481b-a8b8-bb89c05917d8 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.712962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ccbef-a881-492a-8de0-98748d00ed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.713583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ccbef-a881-492a-8de0-98748d00ed00 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.713872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ccbef-a881-492a-8de0-98748d00ed00 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.714144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ccbef-a881-492a-8de0-98748d00ed00 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.717038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:15.723504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ccbef-a881-492a-8de0-98748d00ed00 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:15.732663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ccbef-a881-492a-8de0-98748d00ed00 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-bb6ccbef-a881-492a-8de0-98748d00ed00 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:15.742556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:15.743869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:15.744736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 252/503] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:15.745550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a36fe-cf5e-4b0c-b2d0-1a2b9d6785fa None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.745550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a36fe-cf5e-4b0c-b2d0-1a2b9d6785fa None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.745550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a36fe-cf5e-4b0c-b2d0-1a2b9d6785fa None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.746624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 253/504] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:15.747337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a36fe-cf5e-4b0c-b2d0-1a2b9d6785fa None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.768825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add28e5-4ae5-45df-b722-818ca99be340 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.801699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:15.810571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24449b-bd6a-4fed-b746-4ba9d57c45de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.811175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24449b-bd6a-4fed-b746-4ba9d57c45de None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.811487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24449b-bd6a-4fed-b746-4ba9d57c45de None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.814984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24449b-bd6a-4fed-b746-4ba9d57c45de None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.814984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24449b-bd6a-4fed-b746-4ba9d57c45de None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:15.814984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24449b-bd6a-4fed-b746-4ba9d57c45de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:15.814984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24449b-bd6a-4fed-b746-4ba9d57c45de None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:15.858171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 252/505] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:15.859018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24449b-bd6a-4fed-b746-4ba9d57c45de None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.877053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a36fe-cf5e-4b0c-b2d0-1a2b9d6785fa None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.911379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8964f3d-9da0-4360-805c-8e77348e3d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:15.912001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8964f3d-9da0-4360-805c-8e77348e3d93 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:15.912289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8964f3d-9da0-4360-805c-8e77348e3d93 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:15.912558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8964f3d-9da0-4360-805c-8e77348e3d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:15.922803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8964f3d-9da0-4360-805c-8e77348e3d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:15.924266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8964f3d-9da0-4360-805c-8e77348e3d93 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-e8964f3d-9da0-4360-805c-8e77348e3d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:15.939469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:15.941180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:15.942009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:15.942009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:15.942009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:15.942009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 254/506] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:15.942009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8964f3d-9da0-4360-805c-8e77348e3d93 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:15.964741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24449b-bd6a-4fed-b746-4ba9d57c45de None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:15.990195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:15.999071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8c9c2-de21-4819-9352-11e3f35633ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.004023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8c9c2-de21-4819-9352-11e3f35633ff None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.004023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8c9c2-de21-4819-9352-11e3f35633ff None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.004023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8c9c2-de21-4819-9352-11e3f35633ff None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.004023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8c9c2-de21-4819-9352-11e3f35633ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:16.004023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8c9c2-de21-4819-9352-11e3f35633ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.004023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8c9c2-de21-4819-9352-11e3f35633ff None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.014399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 253/507] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:16.015600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0ce07-1208-440c-8ecc-b859aa004b6a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.015888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0ce07-1208-440c-8ecc-b859aa004b6a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.016165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0ce07-1208-440c-8ecc-b859aa004b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.033579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f6e0ce07-1208-440c-8ecc-b859aa004b6a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:16.034803 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f6e0ce07-1208-440c-8ecc-b859aa004b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:16.042581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8964f3d-9da0-4360-805c-8e77348e3d93 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:16.074829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:16.075796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5d8c1-b837-4d26-ad4a-0234d142800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.076401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5d8c1-b837-4d26-ad4a-0234d142800c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.076685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5d8c1-b837-4d26-ad4a-0234d142800c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.076960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5d8c1-b837-4d26-ad4a-0234d142800c None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.077732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5d8c1-b837-4d26-ad4a-0234d142800c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:16.077994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5d8c1-b837-4d26-ad4a-0234d142800c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.079489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5d8c1-b837-4d26-ad4a-0234d142800c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.102102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 254/508] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:16.102950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0ce07-1208-440c-8ecc-b859aa004b6a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.116915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 255/509] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 07:36:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:16.117372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5d8c1-b837-4d26-ad4a-0234d142800c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.217891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0ce07-1208-440c-8ecc-b859aa004b6a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:16.229840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5d8c1-b837-4d26-ad4a-0234d142800c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:16.237064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:16.255644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71cc13-24c7-4a9b-8a4d-a3314c78647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.256288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71cc13-24c7-4a9b-8a4d-a3314c78647f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.256579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71cc13-24c7-4a9b-8a4d-a3314c78647f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.256858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71cc13-24c7-4a9b-8a4d-a3314c78647f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.266363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4435d-4f4c-49d5-af45-00a02c861ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.266967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4435d-4f4c-49d5-af45-00a02c861ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.267242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4435d-4f4c-49d5-af45-00a02c861ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.267538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4435d-4f4c-49d5-af45-00a02c861ea5 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.268177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4435d-4f4c-49d5-af45-00a02c861ea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:16.268616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4435d-4f4c-49d5-af45-00a02c861ea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.270025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4435d-4f4c-49d5-af45-00a02c861ea5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.281909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 256/510] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:16.282707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4435d-4f4c-49d5-af45-00a02c861ea5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.310529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:16.339756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71cc13-24c7-4a9b-8a4d-a3314c78647f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.342058 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71cc13-24c7-4a9b-8a4d-a3314c78647f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.388387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4435d-4f4c-49d5-af45-00a02c861ea5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:16.421899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a190b9-7b5a-491c-93ea-542b9d1c75f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.422534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a190b9-7b5a-491c-93ea-542b9d1c75f0 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.422802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a190b9-7b5a-491c-93ea-542b9d1c75f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.423097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a190b9-7b5a-491c-93ea-542b9d1c75f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.430790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a190b9-7b5a-491c-93ea-542b9d1c75f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.432275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a190b9-7b5a-491c-93ea-542b9d1c75f0 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-d5a190b9-7b5a-491c-93ea-542b9d1c75f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:16.443219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:16.444199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 257/511] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:16.445071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a190b9-7b5a-491c-93ea-542b9d1c75f0 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.456457 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 255/512] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:16.456457 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71cc13-24c7-4a9b-8a4d-a3314c78647f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.474132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:16.529239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:16.548055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a190b9-7b5a-491c-93ea-542b9d1c75f0 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:16.554374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71cc13-24c7-4a9b-8a4d-a3314c78647f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:16.582173 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14628ed-b6a1-4b9b-954f-de00ca3b86d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.582774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14628ed-b6a1-4b9b-954f-de00ca3b86d4 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.583053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14628ed-b6a1-4b9b-954f-de00ca3b86d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.583366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14628ed-b6a1-4b9b-954f-de00ca3b86d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.587749 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f464f4-24a7-47f1-ab7c-65760b14e23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.588354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f464f4-24a7-47f1-ab7c-65760b14e23d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.588630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f464f4-24a7-47f1-ab7c-65760b14e23d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.588898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f464f4-24a7-47f1-ab7c-65760b14e23d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.596318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f464f4-24a7-47f1-ab7c-65760b14e23d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.597991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f464f4-24a7-47f1-ab7c-65760b14e23d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-10f464f4-24a7-47f1-ab7c-65760b14e23d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:16.608926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:16.609877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:16.610744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 256/513] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:16.611578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f464f4-24a7-47f1-ab7c-65760b14e23d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.654681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14628ed-b6a1-4b9b-954f-de00ca3b86d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.656183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14628ed-b6a1-4b9b-954f-de00ca3b86d4 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.682294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:16.714618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f464f4-24a7-47f1-ab7c-65760b14e23d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:16.749890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e633af-1b7a-47f7-945f-d3c47834c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.750511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e633af-1b7a-47f7-945f-d3c47834c32f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.750789 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e633af-1b7a-47f7-945f-d3c47834c32f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.751066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e633af-1b7a-47f7-945f-d3c47834c32f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.753021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:16.757367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 258/514] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:16.758273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14628ed-b6a1-4b9b-954f-de00ca3b86d4 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.776655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e633af-1b7a-47f7-945f-d3c47834c32f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.776655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e633af-1b7a-47f7-945f-d3c47834c32f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-01e633af-1b7a-47f7-945f-d3c47834c32f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:16.778184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:16.779135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:16.780551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:16.780551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:16.780551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:16.780551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 257/515] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:16.780551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e633af-1b7a-47f7-945f-d3c47834c32f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.865336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14628ed-b6a1-4b9b-954f-de00ca3b86d4 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:16.878966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e633af-1b7a-47f7-945f-d3c47834c32f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:16.890571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:16.899369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ab933-76b2-4d94-859c-a81739610ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.899963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ab933-76b2-4d94-859c-a81739610ae9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.900244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ab933-76b2-4d94-859c-a81739610ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.900520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ab933-76b2-4d94-859c-a81739610ae9 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.901239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ab933-76b2-4d94-859c-a81739610ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:16.901542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ab933-76b2-4d94-859c-a81739610ae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.902965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ab933-76b2-4d94-859c-a81739610ae9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.913145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd313-6262-49a0-aca7-c8c3a2346cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:16.913812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd313-6262-49a0-aca7-c8c3a2346cdd None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:16.914097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd313-6262-49a0-aca7-c8c3a2346cdd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:16.914382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd313-6262-49a0-aca7-c8c3a2346cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:16.920370 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 259/516] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:16.921161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ab933-76b2-4d94-859c-a81739610ae9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.926348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddd313-6262-49a0-aca7-c8c3a2346cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:16.928112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddd313-6262-49a0-aca7-c8c3a2346cdd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-eaddd313-6262-49a0-aca7-c8c3a2346cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:16.942321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:16.943425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:16.944330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:16.944330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:16.944330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:16.944330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 258/517] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:16.944330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd313-6262-49a0-aca7-c8c3a2346cdd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:16.984161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:17.024091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ab933-76b2-4d94-859c-a81739610ae9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.043027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd313-6262-49a0-aca7-c8c3a2346cdd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.058406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3013d5f-b0c0-4413-9b64-9b10046efbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.059009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3013d5f-b0c0-4413-9b64-9b10046efbf1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.059307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3013d5f-b0c0-4413-9b64-9b10046efbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.059597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3013d5f-b0c0-4413-9b64-9b10046efbf1 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.060325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3013d5f-b0c0-4413-9b64-9b10046efbf1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:17.060628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3013d5f-b0c0-4413-9b64-9b10046efbf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.062066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3013d5f-b0c0-4413-9b64-9b10046efbf1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:17.076966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468b0f-6b3d-4e9b-8915-51bf8b83d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.077576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468b0f-6b3d-4e9b-8915-51bf8b83d216 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.077851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468b0f-6b3d-4e9b-8915-51bf8b83d216 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.078118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468b0f-6b3d-4e9b-8915-51bf8b83d216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.079046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 260/518] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:17.079876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3013d5f-b0c0-4413-9b64-9b10046efbf1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:17.092612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8468b0f-6b3d-4e9b-8915-51bf8b83d216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.094088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8468b0f-6b3d-4e9b-8915-51bf8b83d216 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-c8468b0f-6b3d-4e9b-8915-51bf8b83d216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:17.108573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:17.109448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:17.110254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:17.110254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:17.110254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:17.110254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 259/519] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:17.110533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468b0f-6b3d-4e9b-8915-51bf8b83d216 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:17.124497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:17.180724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3013d5f-b0c0-4413-9b64-9b10046efbf1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.200510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:17.210305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468b0f-6b3d-4e9b-8915-51bf8b83d216 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.214720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef42a2a-e092-43e7-9936-1335cba3b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.215345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef42a2a-e092-43e7-9936-1335cba3b396 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.215630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef42a2a-e092-43e7-9936-1335cba3b396 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.215903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef42a2a-e092-43e7-9936-1335cba3b396 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.216539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef42a2a-e092-43e7-9936-1335cba3b396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:17.216840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef42a2a-e092-43e7-9936-1335cba3b396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.218210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef42a2a-e092-43e7-9936-1335cba3b396 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:17.230150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 261/520] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:17.231160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef42a2a-e092-43e7-9936-1335cba3b396 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:17.246117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec501-ba9e-46a7-9ff2-43c9686a137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.246718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec501-ba9e-46a7-9ff2-43c9686a137d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.246999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec501-ba9e-46a7-9ff2-43c9686a137d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.247272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec501-ba9e-46a7-9ff2-43c9686a137d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.316924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec501-ba9e-46a7-9ff2-43c9686a137d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.318302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eec501-ba9e-46a7-9ff2-43c9686a137d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:17.332286 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef42a2a-e092-43e7-9936-1335cba3b396 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.335387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:17.368288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714f907-5340-4efd-9b38-a260f13aca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.368898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714f907-5340-4efd-9b38-a260f13aca23 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.369177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714f907-5340-4efd-9b38-a260f13aca23 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.369443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714f907-5340-4efd-9b38-a260f13aca23 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.370092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714f907-5340-4efd-9b38-a260f13aca23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:17.370392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714f907-5340-4efd-9b38-a260f13aca23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.371833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714f907-5340-4efd-9b38-a260f13aca23 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:17.383148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 262/521] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:17.383975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714f907-5340-4efd-9b38-a260f13aca23 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:17.409971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:17.419936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 260/522] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:17.421846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec501-ba9e-46a7-9ff2-43c9686a137d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:17.485521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714f907-5340-4efd-9b38-a260f13aca23 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.518797 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eec501-ba9e-46a7-9ff2-43c9686a137d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.520370 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c542e6-34de-4001-a177-18b6d85079be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.521605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c542e6-34de-4001-a177-18b6d85079be None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.521605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c542e6-34de-4001-a177-18b6d85079be None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.521605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c542e6-34de-4001-a177-18b6d85079be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.551008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:17.551596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d09e06-fd52-4292-90de-78f8c6f99a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.552433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09e06-fd52-4292-90de-78f8c6f99a09 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.552722 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09e06-fd52-4292-90de-78f8c6f99a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.552995 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09e06-fd52-4292-90de-78f8c6f99a09 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.553634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d09e06-fd52-4292-90de-78f8c6f99a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:17.553937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d09e06-fd52-4292-90de-78f8c6f99a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.555432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d09e06-fd52-4292-90de-78f8c6f99a09 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:17.567813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 261/523] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:17.568352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d09e06-fd52-4292-90de-78f8c6f99a09 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:17.594449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c542e6-34de-4001-a177-18b6d85079be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.595952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c542e6-34de-4001-a177-18b6d85079be None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:17.618686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:17.667556 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d09e06-fd52-4292-90de-78f8c6f99a09 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.697140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 263/524] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:17.697992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c542e6-34de-4001-a177-18b6d85079be None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:17.704489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6543a-c186-4ab8-85c3-58a09156ee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.705085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6543a-c186-4ab8-85c3-58a09156ee45 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.705359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6543a-c186-4ab8-85c3-58a09156ee45 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.705636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6543a-c186-4ab8-85c3-58a09156ee45 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.706340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6543a-c186-4ab8-85c3-58a09156ee45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.707781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6543a-c186-4ab8-85c3-58a09156ee45 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:17.758656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:17.795333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c542e6-34de-4001-a177-18b6d85079be None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.812781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 262/525] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:36:17 2022] POST /identity/v3/users => generated 247 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:17.814151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6543a-c186-4ab8-85c3-58a09156ee45 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:17.832204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81aa31-4039-4c36-a99b-fe08d3044d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.832598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81aa31-4039-4c36-a99b-fe08d3044d11 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.832881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81aa31-4039-4c36-a99b-fe08d3044d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.833154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81aa31-4039-4c36-a99b-fe08d3044d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.841138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81aa31-4039-4c36-a99b-fe08d3044d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.843512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81aa31-4039-4c36-a99b-fe08d3044d11 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-2b81aa31-4039-4c36-a99b-fe08d3044d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:17.857582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:17.858680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:17.859735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:17.859735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:17.859735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:17.859735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:17.859735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:17.859735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:17.859735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:17.859735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:17.859735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 264/526] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:17.860275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81aa31-4039-4c36-a99b-fe08d3044d11 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:17.939039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6543a-c186-4ab8-85c3-58a09156ee45 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.948601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:17.970956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81aa31-4039-4c36-a99b-fe08d3044d11 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:17.980985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc7fd9-f4c5-4555-9042-b42868a8593f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:17.981251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7fd9-f4c5-4555-9042-b42868a8593f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:17.981524 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7fd9-f4c5-4555-9042-b42868a8593f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:17.982017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7fd9-f4c5-4555-9042-b42868a8593f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:17.993149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc7fd9-f4c5-4555-9042-b42868a8593f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:17.994917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc7fd9-f4c5-4555-9042-b42868a8593f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.003121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-52fc7fd9-f4c5-4555-9042-b42868a8593f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:18.013054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:18.014349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:18.015175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:18.015175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:18.015175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:18.015456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba67a3-f941-4175-818d-19031d5761b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.015546 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 263/527] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:18.015613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba67a3-f941-4175-818d-19031d5761b4 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.015613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba67a3-f941-4175-818d-19031d5761b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.015725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc7fd9-f4c5-4555-9042-b42868a8593f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.015796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba67a3-f941-4175-818d-19031d5761b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.024072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba67a3-f941-4175-818d-19031d5761b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.025809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba67a3-f941-4175-818d-19031d5761b4 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-c7ba67a3-f941-4175-818d-19031d5761b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:18.039035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:18.040108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:18.040925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:18.040925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:18.040925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:18.040925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:18.040925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:18.040925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:18.040925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:18.040925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:18.040925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 265/528] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:18.041376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba67a3-f941-4175-818d-19031d5761b4 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.128730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc7fd9-f4c5-4555-9042-b42868a8593f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:18.154966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba67a3-f941-4175-818d-19031d5761b4 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:18.163676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec0a02-537c-4332-9803-4409b8b2efa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.164315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec0a02-537c-4332-9803-4409b8b2efa2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.164604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec0a02-537c-4332-9803-4409b8b2efa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.164874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec0a02-537c-4332-9803-4409b8b2efa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.176751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec0a02-537c-4332-9803-4409b8b2efa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.178492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec0a02-537c-4332-9803-4409b8b2efa2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.191375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18daae-7d4e-4000-a963-2ffa728277ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.191981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18daae-7d4e-4000-a963-2ffa728277ee None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.192260 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18daae-7d4e-4000-a963-2ffa728277ee None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.192533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18daae-7d4e-4000-a963-2ffa728277ee None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.193225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18daae-7d4e-4000-a963-2ffa728277ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-9aec0a02-537c-4332-9803-4409b8b2efa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:18.193397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:18.194227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:18.195063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:18.195063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:18.195063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:18.195232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18daae-7d4e-4000-a963-2ffa728277ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.195232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18daae-7d4e-4000-a963-2ffa728277ee None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.199046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 264/529] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:18.199801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec0a02-537c-4332-9803-4409b8b2efa2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.212612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:18.220297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 266/530] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:18.221088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18daae-7d4e-4000-a963-2ffa728277ee None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.270907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:18.307369 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec0a02-537c-4332-9803-4409b8b2efa2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:18.333788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18daae-7d4e-4000-a963-2ffa728277ee None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:18.345204 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838132e-9bda-46eb-b18a-ae6462be389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.346078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838132e-9bda-46eb-b18a-ae6462be389b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.347137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838132e-9bda-46eb-b18a-ae6462be389b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.347583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838132e-9bda-46eb-b18a-ae6462be389b None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.348387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838132e-9bda-46eb-b18a-ae6462be389b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:18.348838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838132e-9bda-46eb-b18a-ae6462be389b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.350338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838132e-9bda-46eb-b18a-ae6462be389b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.365693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 265/531] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:18.366725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838132e-9bda-46eb-b18a-ae6462be389b None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.379405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35259-de20-4737-928a-e6c123eae529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.379405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35259-de20-4737-928a-e6c123eae529 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.379405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35259-de20-4737-928a-e6c123eae529 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.379405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35259-de20-4737-928a-e6c123eae529 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.379776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e35259-de20-4737-928a-e6c123eae529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:18.379848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e35259-de20-4737-928a-e6c123eae529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.381261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e35259-de20-4737-928a-e6c123eae529 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.393911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 267/532] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:18.395023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35259-de20-4737-928a-e6c123eae529 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.449772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:18.482159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838132e-9bda-46eb-b18a-ae6462be389b None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:18.502056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35259-de20-4737-928a-e6c123eae529 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:18.504630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:18.518877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd112bea-f133-44be-a6bc-51a3eae0096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.519709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd112bea-f133-44be-a6bc-51a3eae0096d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.519992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd112bea-f133-44be-a6bc-51a3eae0096d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.520264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd112bea-f133-44be-a6bc-51a3eae0096d None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.520998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd112bea-f133-44be-a6bc-51a3eae0096d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:18.521302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd112bea-f133-44be-a6bc-51a3eae0096d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.523545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd112bea-f133-44be-a6bc-51a3eae0096d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.541405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 266/533] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:18.542217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd112bea-f133-44be-a6bc-51a3eae0096d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.544835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae54b40-6b92-4f4e-b2bd-4f8e9c476ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.545441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae54b40-6b92-4f4e-b2bd-4f8e9c476ddb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.545737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae54b40-6b92-4f4e-b2bd-4f8e9c476ddb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.545985 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae54b40-6b92-4f4e-b2bd-4f8e9c476ddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.546715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae54b40-6b92-4f4e-b2bd-4f8e9c476ddb None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=f436ac7cc2f04919bb0ec1ad9fca5622) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:18.547133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae54b40-6b92-4f4e-b2bd-4f8e9c476ddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.548607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae54b40-6b92-4f4e-b2bd-4f8e9c476ddb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.563333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 268/534] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/role_assignments?user.id=f436ac7cc2f04919bb0ec1ad9fca5622&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:18.563333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae54b40-6b92-4f4e-b2bd-4f8e9c476ddb None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.677053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae54b40-6b92-4f4e-b2bd-4f8e9c476ddb None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:18.689544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd112bea-f133-44be-a6bc-51a3eae0096d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:18.725912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964798d9-123b-4968-88fb-e005940e0ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.726623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964798d9-123b-4968-88fb-e005940e0ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.726973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964798d9-123b-4968-88fb-e005940e0ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.727704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964798d9-123b-4968-88fb-e005940e0ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.728184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964798d9-123b-4968-88fb-e005940e0ea5 None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=a3de64d734a04f9e9ab0d85e5c985e6a) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:18.728562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964798d9-123b-4968-88fb-e005940e0ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.730094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964798d9-123b-4968-88fb-e005940e0ea5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.733915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:18.738093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 269/535] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/role_assignments?user.id=a3de64d734a04f9e9ab0d85e5c985e6a&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:18.739331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964798d9-123b-4968-88fb-e005940e0ea5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.748341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89709e07-4fb9-4cd8-a98b-08cf2e5e56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.749347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89709e07-4fb9-4cd8-a98b-08cf2e5e56f2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.757621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89709e07-4fb9-4cd8-a98b-08cf2e5e56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.757621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89709e07-4fb9-4cd8-a98b-08cf2e5e56f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.765006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89709e07-4fb9-4cd8-a98b-08cf2e5e56f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.766754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89709e07-4fb9-4cd8-a98b-08cf2e5e56f2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-89709e07-4fb9-4cd8-a98b-08cf2e5e56f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:18.796794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:18.797698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:18.798598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:18.798598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:18.798598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:18.798598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:18.798598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:18.798598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:18.798598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:18.798598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:18.800670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 267/536] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:18.810992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89709e07-4fb9-4cd8-a98b-08cf2e5e56f2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:18.813538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:18.930266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964798d9-123b-4968-88fb-e005940e0ea5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:18.969924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310a72-1e5d-4bfa-9054-ec0fe7b73c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:18.970650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310a72-1e5d-4bfa-9054-ec0fe7b73c0c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:18.970980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310a72-1e5d-4bfa-9054-ec0fe7b73c0c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:18.971846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310a72-1e5d-4bfa-9054-ec0fe7b73c0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:18.980436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310a72-1e5d-4bfa-9054-ec0fe7b73c0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:18.981848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310a72-1e5d-4bfa-9054-ec0fe7b73c0c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:18.987650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89709e07-4fb9-4cd8-a98b-08cf2e5e56f2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-ee310a72-1e5d-4bfa-9054-ec0fe7b73c0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:19.001610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:19.003097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:19.004025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:19.004025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:19.004025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:19.004025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:19.004025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:19.004025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:19.004025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:19.004025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:19.004025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 270/537] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:19.009154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310a72-1e5d-4bfa-9054-ec0fe7b73c0c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:19.029464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d3be5-cf2c-4e6f-972c-bdbadc080fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:19.030500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3be5-cf2c-4e6f-972c-bdbadc080fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:19.030973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3be5-cf2c-4e6f-972c-bdbadc080fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:19.038118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3be5-cf2c-4e6f-972c-bdbadc080fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:19.040232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d3be5-cf2c-4e6f-972c-bdbadc080fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:19.040549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d3be5-cf2c-4e6f-972c-bdbadc080fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:19.042013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d3be5-cf2c-4e6f-972c-bdbadc080fd9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:19.083922 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 268/538] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:19.089951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d3be5-cf2c-4e6f-972c-bdbadc080fd9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:19.147360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:19.196613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:19.206502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d3be5-cf2c-4e6f-972c-bdbadc080fd9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:19.220247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310a72-1e5d-4bfa-9054-ec0fe7b73c0c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:19.244880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aa1af-9c4c-4ab3-9aa2-76d87b31c7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:19.245847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aa1af-9c4c-4ab3-9aa2-76d87b31c7c9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:19.246321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aa1af-9c4c-4ab3-9aa2-76d87b31c7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:19.246785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aa1af-9c4c-4ab3-9aa2-76d87b31c7c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:19.247765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aa1af-9c4c-4ab3-9aa2-76d87b31c7c9 None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=7d8054e88916456991bf485c19f8b502) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:19.248265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aa1af-9c4c-4ab3-9aa2-76d87b31c7c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:19.249991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aa1af-9c4c-4ab3-9aa2-76d87b31c7c9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:19.256337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 269/539] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:19 2022] GET /identity/v3/role_assignments?user.id=7d8054e88916456991bf485c19f8b502&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:19.288214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da0a84-4d88-42bb-8009-5e84a4217bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:19.289216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da0a84-4d88-42bb-8009-5e84a4217bfa None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:19.289706 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da0a84-4d88-42bb-8009-5e84a4217bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:19.290183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da0a84-4d88-42bb-8009-5e84a4217bfa None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:19.291098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da0a84-4d88-42bb-8009-5e84a4217bfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:19.291703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da0a84-4d88-42bb-8009-5e84a4217bfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:19.293410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da0a84-4d88-42bb-8009-5e84a4217bfa None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:19.311883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 271/540] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:19.320352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aa1af-9c4c-4ab3-9aa2-76d87b31c7c9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:19.470854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aa1af-9c4c-4ab3-9aa2-76d87b31c7c9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:19.488424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:19.507849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7843925-349e-42e5-ae86-a9b504e03682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:19.508454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7843925-349e-42e5-ae86-a9b504e03682 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:19.508733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7843925-349e-42e5-ae86-a9b504e03682 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:19.509003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7843925-349e-42e5-ae86-a9b504e03682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:19.509729 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7843925-349e-42e5-ae86-a9b504e03682 None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=a4403ef0835a4d658f8eb50fac0780eb) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:19.510034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7843925-349e-42e5-ae86-a9b504e03682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:19.511488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7843925-349e-42e5-ae86-a9b504e03682 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:19.517309 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 270/541] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:19 2022] GET /identity/v3/role_assignments?user.id=a4403ef0835a4d658f8eb50fac0780eb&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:19.923090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc6456-ab1d-4e26-9057-3c93bbeb54a9 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:19.924078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc6456-ab1d-4e26-9057-3c93bbeb54a9 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:19.924886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc6456-ab1d-4e26-9057-3c93bbeb54a9 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:19.926697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 272/542] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:19.932688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d68d6-8d22-45e3-a002-650cd81d4db8 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:19.933201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d68d6-8d22-45e3-a002-650cd81d4db8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:19.933676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d68d6-8d22-45e3-a002-650cd81d4db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:19.952843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c11d68d6-8d22-45e3-a002-650cd81d4db8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:19.954334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c11d68d6-8d22-45e3-a002-650cd81d4db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:20.128464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 271/543] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:20.538645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc6456-ab1d-4e26-9057-3c93bbeb54a9 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:20.671360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc6456-ab1d-4e26-9057-3c93bbeb54a9 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:20.718118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e5e00-2860-4dac-8e52-9481e2d0aed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:20.718750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e5e00-2860-4dac-8e52-9481e2d0aed9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:20.719035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e5e00-2860-4dac-8e52-9481e2d0aed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:20.719317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e5e00-2860-4dac-8e52-9481e2d0aed9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:20.734298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e5e00-2860-4dac-8e52-9481e2d0aed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-a42e5e00-2860-4dac-8e52-9481e2d0aed9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:20.739761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:20.740626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:20.741442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 273/544] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:20.752451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d68d6-8d22-45e3-a002-650cd81d4db8 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:20.832598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82549c8-8913-4a14-b4c8-2d0a99475647 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:20.832973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82549c8-8913-4a14-b4c8-2d0a99475647 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:20.833158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82549c8-8913-4a14-b4c8-2d0a99475647 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:20.834920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 274/545] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:20.841059 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efdf4a-1c65-44ca-9e88-7317a650e4cc None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:20.841378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efdf4a-1c65-44ca-9e88-7317a650e4cc None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:20.841609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efdf4a-1c65-44ca-9e88-7317a650e4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:20.864052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-29efdf4a-1c65-44ca-9e88-7317a650e4cc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:20.865242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-29efdf4a-1c65-44ca-9e88-7317a650e4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:20.870441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:20.938468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d68d6-8d22-45e3-a002-650cd81d4db8 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:20.967822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 275/546] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:21.017196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:21.061359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d19ce-ae55-4681-a73d-3f095977f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:21.061976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d19ce-ae55-4681-a73d-3f095977f6db None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.062269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d19ce-ae55-4681-a73d-3f095977f6db None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.062553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d19ce-ae55-4681-a73d-3f095977f6db None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.063220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d19ce-ae55-4681-a73d-3f095977f6db None admin] RBAC: Adding query filter params (name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:21.063556 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d19ce-ae55-4681-a73d-3f095977f6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:21.065465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d19ce-ae55-4681-a73d-3f095977f6db None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:21.074217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 272/547] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:21.079830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efdf4a-1c65-44ca-9e88-7317a650e4cc None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:21.142577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c66246-3d78-43e4-8770-62c10f936b9f None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.144097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c66246-3d78-43e4-8770-62c10f936b9f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.144576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c66246-3d78-43e4-8770-62c10f936b9f None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.146371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 273/548] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:36:21.151605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9e81-a4f9-409c-b4c0-4469c2e13562 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.152125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9e81-a4f9-409c-b4c0-4469c2e13562 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.152634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9e81-a4f9-409c-b4c0-4469c2e13562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.170872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-4b7d9e81-a4f9-409c-b4c0-4469c2e13562 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:21.172414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4b7d9e81-a4f9-409c-b4c0-4469c2e13562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:21.194242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efdf4a-1c65-44ca-9e88-7317a650e4cc None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:21.230899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824f797-f23d-4d78-8a04-7afe3df1ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:21.231570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824f797-f23d-4d78-8a04-7afe3df1ec0f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.231862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824f797-f23d-4d78-8a04-7afe3df1ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.232146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824f797-f23d-4d78-8a04-7afe3df1ec0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.245327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824f797-f23d-4d78-8a04-7afe3df1ec0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:21.247032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824f797-f23d-4d78-8a04-7afe3df1ec0f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-1824f797-f23d-4d78-8a04-7afe3df1ec0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:21.262864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:21.263837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:21.264667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:21.264667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:21.264667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:21.264667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 276/549] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:21.265416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:21.270643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824f797-f23d-4d78-8a04-7afe3df1ec0f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:21.324325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 274/550] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:21.325243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9e81-a4f9-409c-b4c0-4469c2e13562 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:21.432875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824f797-f23d-4d78-8a04-7afe3df1ec0f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:21.470538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c66b-2552-44dc-9e9d-4529a26cd664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:21.471445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c66b-2552-44dc-9e9d-4529a26cd664 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.471872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c66b-2552-44dc-9e9d-4529a26cd664 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.472910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c66b-2552-44dc-9e9d-4529a26cd664 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.473716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914c66b-2552-44dc-9e9d-4529a26cd664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:21.474195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914c66b-2552-44dc-9e9d-4529a26cd664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:21.475829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914c66b-2552-44dc-9e9d-4529a26cd664 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:21.489998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 277/551] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:21.496368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c66b-2552-44dc-9e9d-4529a26cd664 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:21.556988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:21.565709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d9e81-a4f9-409c-b4c0-4469c2e13562 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:21.569600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:21.630980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca01717-853d-4d96-ac8e-b57f3a997a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:21.631648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01717-853d-4d96-ac8e-b57f3a997a5c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.631929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01717-853d-4d96-ac8e-b57f3a997a5c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.632202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01717-853d-4d96-ac8e-b57f3a997a5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.633018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c66b-2552-44dc-9e9d-4529a26cd664 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:21.643533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca01717-853d-4d96-ac8e-b57f3a997a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-bca01717-853d-4d96-ac8e-b57f3a997a5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:21.648725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:21.649826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:21.650830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 275/552] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:21.651596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca01717-853d-4d96-ac8e-b57f3a997a5c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:21.679210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8c1ca-e3f8-430b-931d-d8a2cca4819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:21.680503 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8c1ca-e3f8-430b-931d-d8a2cca4819b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.680796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8c1ca-e3f8-430b-931d-d8a2cca4819b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.681084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8c1ca-e3f8-430b-931d-d8a2cca4819b None admin] PATH_INFO: `/v3/users/swift` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.693168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8c1ca-e3f8-430b-931d-d8a2cca4819b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:21.694816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8c1ca-e3f8-430b-931d-d8a2cca4819b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-c3c8c1ca-e3f8-430b-931d-d8a2cca4819b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:21.711917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:21.712874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:21.713762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 278/553] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:21.714392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8c1ca-e3f8-430b-931d-d8a2cca4819b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:21.780190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca01717-853d-4d96-ac8e-b57f3a997a5c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:21.821145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dac01c-23f7-4bd3-ae88-d4787346063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:21.822055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac01c-23f7-4bd3-ae88-d4787346063e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.822339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac01c-23f7-4bd3-ae88-d4787346063e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.822613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dac01c-23f7-4bd3-ae88-d4787346063e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.834195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dac01c-23f7-4bd3-ae88-d4787346063e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:21.837068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8c1ca-e3f8-430b-931d-d8a2cca4819b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-53dac01c-23f7-4bd3-ae88-d4787346063e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:21.838933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:21.839973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 276/554] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:21.840819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dac01c-23f7-4bd3-ae88-d4787346063e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:21.857708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:21.868917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:21.882904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed447242-bc95-4d76-a349-b3b338218070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:21.883551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed447242-bc95-4d76-a349-b3b338218070 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.883831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed447242-bc95-4d76-a349-b3b338218070 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.884105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed447242-bc95-4d76-a349-b3b338218070 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.884775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed447242-bc95-4d76-a349-b3b338218070 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:21.885081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed447242-bc95-4d76-a349-b3b338218070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:21.886447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed447242-bc95-4d76-a349-b3b338218070 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:21.895625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 279/555] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:21.896908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d333a-5252-4c38-a75a-3d56d8e7b1df None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:21.897195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d333a-5252-4c38-a75a-3d56d8e7b1df None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:21.897475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d333a-5252-4c38-a75a-3d56d8e7b1df None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:21.898838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 280/556] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:21.900091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d333a-5252-4c38-a75a-3d56d8e7b1df None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:21.957238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dac01c-23f7-4bd3-ae88-d4787346063e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.007471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d333a-5252-4c38-a75a-3d56d8e7b1df None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.031461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9d7d-af33-4c32-9388-189d75b9c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.032003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9d7d-af33-4c32-9388-189d75b9c76e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.032281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9d7d-af33-4c32-9388-189d75b9c76e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.032557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9d7d-af33-4c32-9388-189d75b9c76e None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.033283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc9d7d-af33-4c32-9388-189d75b9c76e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:22.034109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc9d7d-af33-4c32-9388-189d75b9c76e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.035590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc9d7d-af33-4c32-9388-189d75b9c76e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.041412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120d185-b860-4f4f-a90d-7008ad9104b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.042001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120d185-b860-4f4f-a90d-7008ad9104b8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.042284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120d185-b860-4f4f-a90d-7008ad9104b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.042554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120d185-b860-4f4f-a90d-7008ad9104b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.043216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120d185-b860-4f4f-a90d-7008ad9104b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:22.043547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120d185-b860-4f4f-a90d-7008ad9104b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.044893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120d185-b860-4f4f-a90d-7008ad9104b8 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.053271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 277/557] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 07:36:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:22.058098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 281/558] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:22.058266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9d7d-af33-4c32-9388-189d75b9c76e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:22.058361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec48d88-626d-4ea1-9e9e-9d3f7a648abc None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.058361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec48d88-626d-4ea1-9e9e-9d3f7a648abc None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.058361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec48d88-626d-4ea1-9e9e-9d3f7a648abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.073864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-aec48d88-626d-4ea1-9e9e-9d3f7a648abc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:22.075050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-aec48d88-626d-4ea1-9e9e-9d3f7a648abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:22.103474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:22.134944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:22.141217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 282/559] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:22.142286 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc7bdf-7ad6-4050-a82d-e3f104b6f8db None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.142574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc7bdf-7ad6-4050-a82d-e3f104b6f8db None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.143476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc7bdf-7ad6-4050-a82d-e3f104b6f8db None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.144153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 283/560] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:22.144859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc7bdf-7ad6-4050-a82d-e3f104b6f8db None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:22.162931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9d7d-af33-4c32-9388-189d75b9c76e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.198424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87cf0-a634-42bd-b7e6-73589f866c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.199358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87cf0-a634-42bd-b7e6-73589f866c54 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.199823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87cf0-a634-42bd-b7e6-73589f866c54 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.200099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87cf0-a634-42bd-b7e6-73589f866c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.210583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a87cf0-a634-42bd-b7e6-73589f866c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.212525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a87cf0-a634-42bd-b7e6-73589f866c54 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-83a87cf0-a634-42bd-b7e6-73589f866c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:22.228154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:22.233886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:22.234832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:22.234832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:22.234832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:22.234832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 278/561] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:22.234832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87cf0-a634-42bd-b7e6-73589f866c54 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:22.272937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc7bdf-7ad6-4050-a82d-e3f104b6f8db None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.309585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267f186-2e64-4cab-9c0f-41a7bc290c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.310111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267f186-2e64-4cab-9c0f-41a7bc290c4a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.310398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267f186-2e64-4cab-9c0f-41a7bc290c4a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.310680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267f186-2e64-4cab-9c0f-41a7bc290c4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.336126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87cf0-a634-42bd-b7e6-73589f866c54 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.352399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:22.373414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:22.381062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d99a0-24dc-4d70-b6a0-3cabc89c6fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.381830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d99a0-24dc-4d70-b6a0-3cabc89c6fd7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.382115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d99a0-24dc-4d70-b6a0-3cabc89c6fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.382670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d99a0-24dc-4d70-b6a0-3cabc89c6fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.389844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267f186-2e64-4cab-9c0f-41a7bc290c4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.391334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267f186-2e64-4cab-9c0f-41a7bc290c4a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.396254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d99a0-24dc-4d70-b6a0-3cabc89c6fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.397845 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d99a0-24dc-4d70-b6a0-3cabc89c6fd7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-970d99a0-24dc-4d70-b6a0-3cabc89c6fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:22.414955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:22.415940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:22.416802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:22.416802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:22.416802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:22.416802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 279/562] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:22.417221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79792d-a2c8-43b6-955a-17ec0668348f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.417448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79792d-a2c8-43b6-955a-17ec0668348f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.417742 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79792d-a2c8-43b6-955a-17ec0668348f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.434981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-bf79792d-a2c8-43b6-955a-17ec0668348f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:22.436182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bf79792d-a2c8-43b6-955a-17ec0668348f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:22.497692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 284/563] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:22.498750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267f186-2e64-4cab-9c0f-41a7bc290c4a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:22.502339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 280/564] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:22.503385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79792d-a2c8-43b6-955a-17ec0668348f None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:22.571195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:22.606824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267f186-2e64-4cab-9c0f-41a7bc290c4a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.615477 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79792d-a2c8-43b6-955a-17ec0668348f None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.628856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:22.647889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decf23d-62c8-40b9-8f4b-208b01bb8a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.648492 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decf23d-62c8-40b9-8f4b-208b01bb8a3c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.648778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decf23d-62c8-40b9-8f4b-208b01bb8a3c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.649054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decf23d-62c8-40b9-8f4b-208b01bb8a3c None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.649694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decf23d-62c8-40b9-8f4b-208b01bb8a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:22.649992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decf23d-62c8-40b9-8f4b-208b01bb8a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.650307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776949-ecfa-49d3-9020-fa1df39549ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.650937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776949-ecfa-49d3-9020-fa1df39549ac None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.651217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776949-ecfa-49d3-9020-fa1df39549ac None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.651389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decf23d-62c8-40b9-8f4b-208b01bb8a3c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.651542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776949-ecfa-49d3-9020-fa1df39549ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.663951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776949-ecfa-49d3-9020-fa1df39549ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:22.669270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 285/565] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:22.669270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decf23d-62c8-40b9-8f4b-208b01bb8a3c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-db776949-ecfa-49d3-9020-fa1df39549ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:22.669479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:22.670719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 281/566] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:22.671709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776949-ecfa-49d3-9020-fa1df39549ac None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:22.783778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776949-ecfa-49d3-9020-fa1df39549ac None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.787561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decf23d-62c8-40b9-8f4b-208b01bb8a3c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.813322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:22.820216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dc661-4aa9-4a51-9905-69d06da79adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.820846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dc661-4aa9-4a51-9905-69d06da79adf None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.821123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dc661-4aa9-4a51-9905-69d06da79adf None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.821452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dc661-4aa9-4a51-9905-69d06da79adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.822413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f737c77-db1b-43ad-ab1f-509625634c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.823020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f737c77-db1b-43ad-ab1f-509625634c2c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.823333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f737c77-db1b-43ad-ab1f-509625634c2c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.823612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f737c77-db1b-43ad-ab1f-509625634c2c None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.824254 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f737c77-db1b-43ad-ab1f-509625634c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:22.824559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f737c77-db1b-43ad-ab1f-509625634c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.825950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f737c77-db1b-43ad-ab1f-509625634c2c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.832165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dc661-4aa9-4a51-9905-69d06da79adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.839125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dc661-4aa9-4a51-9905-69d06da79adf None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.839274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 286/567] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:22.839274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f737c77-db1b-43ad-ab1f-509625634c2c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-e66dc661-4aa9-4a51-9905-69d06da79adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:22.849272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:22.850202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:22.851057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:22.851057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:22.851057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:22.851057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 282/568] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:22.851578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dc661-4aa9-4a51-9905-69d06da79adf None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:22.876401 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:22.945383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f737c77-db1b-43ad-ab1f-509625634c2c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.953036 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dc661-4aa9-4a51-9905-69d06da79adf None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:22.979748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470116e4-8a42-430a-a636-549263a717eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.980359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470116e4-8a42-430a-a636-549263a717eb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.980642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470116e4-8a42-430a-a636-549263a717eb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.980914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470116e4-8a42-430a-a636-549263a717eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.986497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd678d1c-05f6-4ee9-8f96-7a1764e923d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:22.987096 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd678d1c-05f6-4ee9-8f96-7a1764e923d9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:22.987410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd678d1c-05f6-4ee9-8f96-7a1764e923d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:22.987688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd678d1c-05f6-4ee9-8f96-7a1764e923d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:22.987911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470116e4-8a42-430a-a636-549263a717eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.988342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd678d1c-05f6-4ee9-8f96-7a1764e923d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:22.988646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd678d1c-05f6-4ee9-8f96-7a1764e923d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:22.989352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470116e4-8a42-430a-a636-549263a717eb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.989979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd678d1c-05f6-4ee9-8f96-7a1764e923d9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:22.997785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 283/569] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:22.998570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd678d1c-05f6-4ee9-8f96-7a1764e923d9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-470116e4-8a42-430a-a636-549263a717eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:23.000634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:23.001525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:36:23.002958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:23.006968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 287/570] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:23.007753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470116e4-8a42-430a-a636-549263a717eb None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.053724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:23.085209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:23.099978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd678d1c-05f6-4ee9-8f96-7a1764e923d9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.108211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470116e4-8a42-430a-a636-549263a717eb None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.134976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edb16d-5d45-4970-a767-f091b0afe5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.135624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edb16d-5d45-4970-a767-f091b0afe5ca None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.135903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edb16d-5d45-4970-a767-f091b0afe5ca None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.136175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edb16d-5d45-4970-a767-f091b0afe5ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.142250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b55904-5121-4004-b870-1af23b4d0e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.143494 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55904-5121-4004-b870-1af23b4d0e0e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.143795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55904-5121-4004-b870-1af23b4d0e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.144080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55904-5121-4004-b870-1af23b4d0e0e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.146163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edb16d-5d45-4970-a767-f091b0afe5ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-81edb16d-5d45-4970-a767-f091b0afe5ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:23.150921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:23.151848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:23.152679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:23.153329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b55904-5121-4004-b870-1af23b4d0e0e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.153400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 284/571] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:23.153400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edb16d-5d45-4970-a767-f091b0afe5ca None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.153534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b55904-5121-4004-b870-1af23b4d0e0e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-91b55904-5121-4004-b870-1af23b4d0e0e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:23.165267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:23.170967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 288/572] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:23.172004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b55904-5121-4004-b870-1af23b4d0e0e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.253329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edb16d-5d45-4970-a767-f091b0afe5ca None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.268440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b55904-5121-4004-b870-1af23b4d0e0e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.275330 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:23.286113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb5b71-63b2-4eb2-8761-4e3bb647d028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.286713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb5b71-63b2-4eb2-8761-4e3bb647d028 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.286989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb5b71-63b2-4eb2-8761-4e3bb647d028 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.287257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb5b71-63b2-4eb2-8761-4e3bb647d028 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.287926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb5b71-63b2-4eb2-8761-4e3bb647d028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:23.288227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb5b71-63b2-4eb2-8761-4e3bb647d028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.289575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb5b71-63b2-4eb2-8761-4e3bb647d028 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.301268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 285/573] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:23.302323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb5b71-63b2-4eb2-8761-4e3bb647d028 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.303210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32336092-d26b-44cb-badd-bf0e589ba3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.303874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32336092-d26b-44cb-badd-bf0e589ba3f1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.304157 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32336092-d26b-44cb-badd-bf0e589ba3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.304427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32336092-d26b-44cb-badd-bf0e589ba3f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.311046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:23.316408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32336092-d26b-44cb-badd-bf0e589ba3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.317873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32336092-d26b-44cb-badd-bf0e589ba3f1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-32336092-d26b-44cb-badd-bf0e589ba3f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:23.332304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:23.338019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:23.339193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:23.339193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:23.339193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:23.339193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 289/574] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:23.339193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32336092-d26b-44cb-badd-bf0e589ba3f1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.408598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb5b71-63b2-4eb2-8761-4e3bb647d028 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.437480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32336092-d26b-44cb-badd-bf0e589ba3f1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.441780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d877b9-baa0-432c-8cbc-666ae60e02d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.442385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d877b9-baa0-432c-8cbc-666ae60e02d2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.442664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d877b9-baa0-432c-8cbc-666ae60e02d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.442938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d877b9-baa0-432c-8cbc-666ae60e02d2 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.443695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d877b9-baa0-432c-8cbc-666ae60e02d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:23.444006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d877b9-baa0-432c-8cbc-666ae60e02d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.445429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d877b9-baa0-432c-8cbc-666ae60e02d2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.462168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 286/575] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:23.462969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d877b9-baa0-432c-8cbc-666ae60e02d2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.471684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da85a7e-fcca-4d1e-b934-9f23fd2cb8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.472296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da85a7e-fcca-4d1e-b934-9f23fd2cb8c6 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.472576 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da85a7e-fcca-4d1e-b934-9f23fd2cb8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.472848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da85a7e-fcca-4d1e-b934-9f23fd2cb8c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.473512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da85a7e-fcca-4d1e-b934-9f23fd2cb8c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:23.473816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da85a7e-fcca-4d1e-b934-9f23fd2cb8c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.475185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da85a7e-fcca-4d1e-b934-9f23fd2cb8c6 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.482970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 290/576] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:23.483780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da85a7e-fcca-4d1e-b934-9f23fd2cb8c6 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.506670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:23.526895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:23.564078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d877b9-baa0-432c-8cbc-666ae60e02d2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.584195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da85a7e-fcca-4d1e-b934-9f23fd2cb8c6 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.598745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5928a-79e6-429c-8d31-0bb85180c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.599462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5928a-79e6-429c-8d31-0bb85180c6ba None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.599746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5928a-79e6-429c-8d31-0bb85180c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.600023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5928a-79e6-429c-8d31-0bb85180c6ba None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.600744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5928a-79e6-429c-8d31-0bb85180c6ba None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:23.601048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5928a-79e6-429c-8d31-0bb85180c6ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.602484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5928a-79e6-429c-8d31-0bb85180c6ba None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.616961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0117e-a096-452f-b402-2e8040205316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.617573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0117e-a096-452f-b402-2e8040205316 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.617846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0117e-a096-452f-b402-2e8040205316 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.618112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0117e-a096-452f-b402-2e8040205316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.620156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 287/577] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:23.621043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5928a-79e6-429c-8d31-0bb85180c6ba None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.624959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0117e-a096-452f-b402-2e8040205316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.626605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0117e-a096-452f-b402-2e8040205316 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-5ab0117e-a096-452f-b402-2e8040205316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:23.638321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:23.639327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:23.640250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:23.640250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:23.640250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:23.640250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:23.640250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:23.640250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:23.640250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:23.640250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:23.640250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 291/578] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:23.640743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0117e-a096-452f-b402-2e8040205316 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.720324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:23.721846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5928a-79e6-429c-8d31-0bb85180c6ba None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.739785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0117e-a096-452f-b402-2e8040205316 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.745381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:23.756550 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea5a50-a67f-463d-8b9d-3ce1ca181ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.757152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea5a50-a67f-463d-8b9d-3ce1ca181ca1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.757432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea5a50-a67f-463d-8b9d-3ce1ca181ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.757704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea5a50-a67f-463d-8b9d-3ce1ca181ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.758343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea5a50-a67f-463d-8b9d-3ce1ca181ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:23.758650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea5a50-a67f-463d-8b9d-3ce1ca181ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.760057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea5a50-a67f-463d-8b9d-3ce1ca181ca1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.771114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 288/579] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:23.771862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea5a50-a67f-463d-8b9d-3ce1ca181ca1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.776684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfefee-31a7-4869-8f1d-e329904a5c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.777376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfefee-31a7-4869-8f1d-e329904a5c3c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.777718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfefee-31a7-4869-8f1d-e329904a5c3c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.778050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfefee-31a7-4869-8f1d-e329904a5c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.789514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfefee-31a7-4869-8f1d-e329904a5c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.790963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfefee-31a7-4869-8f1d-e329904a5c3c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-a2cfefee-31a7-4869-8f1d-e329904a5c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:23.805376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:23.806329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:23.807201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:23.807201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:23.807201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:23.807201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 292/580] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:23.807476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfefee-31a7-4869-8f1d-e329904a5c3c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.874390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea5a50-a67f-463d-8b9d-3ce1ca181ca1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.907076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2371ddd-dc44-4506-a9b5-bebd9960a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.907248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfefee-31a7-4869-8f1d-e329904a5c3c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:23.907716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2371ddd-dc44-4506-a9b5-bebd9960a57a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.907982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2371ddd-dc44-4506-a9b5-bebd9960a57a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.908291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2371ddd-dc44-4506-a9b5-bebd9960a57a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.919008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2371ddd-dc44-4506-a9b5-bebd9960a57a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.920482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2371ddd-dc44-4506-a9b5-bebd9960a57a None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-a2371ddd-dc44-4506-a9b5-bebd9960a57a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:23.940236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:23.941366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:23.942301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:23.942301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:23.942301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:23.942470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:23.942541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 289/581] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:23.942541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2371ddd-dc44-4506-a9b5-bebd9960a57a None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.950659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ebdbf-9375-4e83-8f92-3fe2d317a8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:23.951315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ebdbf-9375-4e83-8f92-3fe2d317a8b8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:23.951604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ebdbf-9375-4e83-8f92-3fe2d317a8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:23.951881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ebdbf-9375-4e83-8f92-3fe2d317a8b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:23.963067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ebdbf-9375-4e83-8f92-3fe2d317a8b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:23.964562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ebdbf-9375-4e83-8f92-3fe2d317a8b8 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-912ebdbf-9375-4e83-8f92-3fe2d317a8b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:23.981312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:23.982272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:23.983147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:23.983147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:23.983147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:23.983147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 293/582] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:23.983396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ebdbf-9375-4e83-8f92-3fe2d317a8b8 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:23.998857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:24.064301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2371ddd-dc44-4506-a9b5-bebd9960a57a None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.082939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ebdbf-9375-4e83-8f92-3fe2d317a8b8 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.097493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aac0d7-7a70-4e6a-b932-589f92b6ee17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.098088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aac0d7-7a70-4e6a-b932-589f92b6ee17 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.098360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aac0d7-7a70-4e6a-b932-589f92b6ee17 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.098625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aac0d7-7a70-4e6a-b932-589f92b6ee17 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.099328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aac0d7-7a70-4e6a-b932-589f92b6ee17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:24.099631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aac0d7-7a70-4e6a-b932-589f92b6ee17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.101062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aac0d7-7a70-4e6a-b932-589f92b6ee17 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.112766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 290/583] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:24.113600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aac0d7-7a70-4e6a-b932-589f92b6ee17 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.121826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330539d1-b4c7-4131-b804-9f7aecde901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.122467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330539d1-b4c7-4131-b804-9f7aecde901b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.122748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330539d1-b4c7-4131-b804-9f7aecde901b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.123024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330539d1-b4c7-4131-b804-9f7aecde901b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.131080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330539d1-b4c7-4131-b804-9f7aecde901b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.132505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330539d1-b4c7-4131-b804-9f7aecde901b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-330539d1-b4c7-4131-b804-9f7aecde901b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:24.144143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:24.145263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 294/584] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:24.146392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330539d1-b4c7-4131-b804-9f7aecde901b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.194736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:24.208588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:24.215108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aac0d7-7a70-4e6a-b932-589f92b6ee17 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.249200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b57b0f-6e9f-4283-834c-3010b69218a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.249650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330539d1-b4c7-4131-b804-9f7aecde901b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.249836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b57b0f-6e9f-4283-834c-3010b69218a7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.250117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b57b0f-6e9f-4283-834c-3010b69218a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.250388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b57b0f-6e9f-4283-834c-3010b69218a7 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.251077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b57b0f-6e9f-4283-834c-3010b69218a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:24.251359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b57b0f-6e9f-4283-834c-3010b69218a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.253751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b57b0f-6e9f-4283-834c-3010b69218a7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.265535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 291/585] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:24.269233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b57b0f-6e9f-4283-834c-3010b69218a7 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.294326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483509c-3ed0-4658-8e39-a9e02e5c55fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.294927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483509c-3ed0-4658-8e39-a9e02e5c55fd None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.295200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483509c-3ed0-4658-8e39-a9e02e5c55fd None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.295497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483509c-3ed0-4658-8e39-a9e02e5c55fd None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.296127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483509c-3ed0-4658-8e39-a9e02e5c55fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:24.296429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483509c-3ed0-4658-8e39-a9e02e5c55fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.297796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483509c-3ed0-4658-8e39-a9e02e5c55fd None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.316108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 295/586] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:24.316108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483509c-3ed0-4658-8e39-a9e02e5c55fd None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.369458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b57b0f-6e9f-4283-834c-3010b69218a7 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.403899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226cbe2-1a96-406c-bfe0-c0ecfc3e7c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.404425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226cbe2-1a96-406c-bfe0-c0ecfc3e7c66 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.404702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226cbe2-1a96-406c-bfe0-c0ecfc3e7c66 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.404975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226cbe2-1a96-406c-bfe0-c0ecfc3e7c66 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.405607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226cbe2-1a96-406c-bfe0-c0ecfc3e7c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:24.405911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226cbe2-1a96-406c-bfe0-c0ecfc3e7c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.407269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226cbe2-1a96-406c-bfe0-c0ecfc3e7c66 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.412950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483509c-3ed0-4658-8e39-a9e02e5c55fd None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.415685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:24.419349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 292/587] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:24.420202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226cbe2-1a96-406c-bfe0-c0ecfc3e7c66 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.438861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:24.448633 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9a584-4d9c-401f-a41c-4b52785eb7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.449233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a584-4d9c-401f-a41c-4b52785eb7ac None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.449515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a584-4d9c-401f-a41c-4b52785eb7ac None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.449789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a584-4d9c-401f-a41c-4b52785eb7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.450513 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9a584-4d9c-401f-a41c-4b52785eb7ac None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=15d9847a3a5048efb19e507f988e37f4) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:24.450823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9a584-4d9c-401f-a41c-4b52785eb7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.452319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9a584-4d9c-401f-a41c-4b52785eb7ac None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.458158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 296/588] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/role_assignments?user.id=15d9847a3a5048efb19e507f988e37f4&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:24.458939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9a584-4d9c-401f-a41c-4b52785eb7ac None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.532950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226cbe2-1a96-406c-bfe0-c0ecfc3e7c66 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.571358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00d19a-b883-4863-a9b2-a2ef4e574262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.571988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d19a-b883-4863-a9b2-a2ef4e574262 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.572271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d19a-b883-4863-a9b2-a2ef4e574262 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.572548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d19a-b883-4863-a9b2-a2ef4e574262 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.573294 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00d19a-b883-4863-a9b2-a2ef4e574262 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:24.573604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00d19a-b883-4863-a9b2-a2ef4e574262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.575090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00d19a-b883-4863-a9b2-a2ef4e574262 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.589137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9a584-4d9c-401f-a41c-4b52785eb7ac None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.599247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 293/589] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:24.599247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00d19a-b883-4863-a9b2-a2ef4e574262 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.631251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107f866-7786-487a-872b-a46099975667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.632000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107f866-7786-487a-872b-a46099975667 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.632288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107f866-7786-487a-872b-a46099975667 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.632567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107f866-7786-487a-872b-a46099975667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.639483 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107f866-7786-487a-872b-a46099975667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.640932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107f866-7786-487a-872b-a46099975667 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-d107f866-7786-487a-872b-a46099975667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:24.653186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:24.654238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 297/590] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:24.655138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107f866-7786-487a-872b-a46099975667 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.683630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:24.687626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:24.723849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00d19a-b883-4863-a9b2-a2ef4e574262 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.760673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107f866-7786-487a-872b-a46099975667 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.765270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa827d7c-11b5-4c5e-8ae4-d1d850afd8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.765270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa827d7c-11b5-4c5e-8ae4-d1d850afd8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.765270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa827d7c-11b5-4c5e-8ae4-d1d850afd8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.765270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa827d7c-11b5-4c5e-8ae4-d1d850afd8d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.773811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa827d7c-11b5-4c5e-8ae4-d1d850afd8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.775252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa827d7c-11b5-4c5e-8ae4-d1d850afd8d8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-fa827d7c-11b5-4c5e-8ae4-d1d850afd8d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:24.787548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:24.788465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:24.789384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 294/591] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:24.789958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa827d7c-11b5-4c5e-8ae4-d1d850afd8d8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.804564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca491e6-50ce-4a6e-94fb-6c248c97bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.805199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca491e6-50ce-4a6e-94fb-6c248c97bb02 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.805495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca491e6-50ce-4a6e-94fb-6c248c97bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.805755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca491e6-50ce-4a6e-94fb-6c248c97bb02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.813785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca491e6-50ce-4a6e-94fb-6c248c97bb02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.816278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca491e6-50ce-4a6e-94fb-6c248c97bb02 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-2ca491e6-50ce-4a6e-94fb-6c248c97bb02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:24.827252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:24.828177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:24.829064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:24.829064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:24.829064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:24.829064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:24.829064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:24.829064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:24.829064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:24.829064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:24.833226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 298/592] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:24.834194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca491e6-50ce-4a6e-94fb-6c248c97bb02 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.902061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa827d7c-11b5-4c5e-8ae4-d1d850afd8d8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.926272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:24.935940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:24.938382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca491e6-50ce-4a6e-94fb-6c248c97bb02 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:24.942548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb718f-5cbb-4930-8082-90ecff9d3d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.943695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb718f-5cbb-4930-8082-90ecff9d3d03 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.948206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb718f-5cbb-4930-8082-90ecff9d3d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.948206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb718f-5cbb-4930-8082-90ecff9d3d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.958244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb718f-5cbb-4930-8082-90ecff9d3d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.960242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb718f-5cbb-4930-8082-90ecff9d3d03 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.976608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579ac4-b050-44ae-9d06-a9ce463b30c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:24.977253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579ac4-b050-44ae-9d06-a9ce463b30c7 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:24.977535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579ac4-b050-44ae-9d06-a9ce463b30c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:24.977911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579ac4-b050-44ae-9d06-a9ce463b30c7 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:24.978991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8579ac4-b050-44ae-9d06-a9ce463b30c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:24.979583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8579ac4-b050-44ae-9d06-a9ce463b30c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-3afb718f-5cbb-4930-8082-90ecff9d3d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:24.981199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:24.982140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:24.983104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:24.983104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:24.983104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:24.983309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8579ac4-b050-44ae-9d06-a9ce463b30c7 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:24.987703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 295/593] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:24.989690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb718f-5cbb-4930-8082-90ecff9d3d03 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:24.996858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 299/594] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:24.996858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579ac4-b050-44ae-9d06-a9ce463b30c7 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:25.115815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579ac4-b050-44ae-9d06-a9ce463b30c7 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:25.122238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb718f-5cbb-4930-8082-90ecff9d3d03 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:25.149775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616623de-d8ad-4bfa-9610-9b96fc05f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:25.150377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616623de-d8ad-4bfa-9610-9b96fc05f8a0 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:25.150669 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616623de-d8ad-4bfa-9610-9b96fc05f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:25.150951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616623de-d8ad-4bfa-9610-9b96fc05f8a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:25.151670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616623de-d8ad-4bfa-9610-9b96fc05f8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:25.151985 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616623de-d8ad-4bfa-9610-9b96fc05f8a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:25.153492 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616623de-d8ad-4bfa-9610-9b96fc05f8a0 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:25.162846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6b80c-c2b2-48fa-bc7f-8fc52918e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:25.163664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6b80c-c2b2-48fa-bc7f-8fc52918e541 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:25.164094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6b80c-c2b2-48fa-bc7f-8fc52918e541 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:25.164517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6b80c-c2b2-48fa-bc7f-8fc52918e541 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:25.165924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6b80c-c2b2-48fa-bc7f-8fc52918e541 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:25.171500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6b80c-c2b2-48fa-bc7f-8fc52918e541 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:25.171642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 300/595] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:25.171642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616623de-d8ad-4bfa-9610-9b96fc05f8a0 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:25.171781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6b80c-c2b2-48fa-bc7f-8fc52918e541 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:25.182271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:25.192412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 296/596] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 07:36:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:25.193531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6b80c-c2b2-48fa-bc7f-8fc52918e541 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:25.240053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:25.285774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616623de-d8ad-4bfa-9610-9b96fc05f8a0 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:25.297996 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6b80c-c2b2-48fa-bc7f-8fc52918e541 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:25.323282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07005999-1de4-472b-baa8-029019dc6f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:25.323909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07005999-1de4-472b-baa8-029019dc6f71 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:25.324182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07005999-1de4-472b-baa8-029019dc6f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:25.324648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07005999-1de4-472b-baa8-029019dc6f71 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:25.325119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07005999-1de4-472b-baa8-029019dc6f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:25.325419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07005999-1de4-472b-baa8-029019dc6f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:25.326777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07005999-1de4-472b-baa8-029019dc6f71 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:25.342895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 301/597] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:25.343086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe11753-af8a-482e-a382-50e53722c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:25.343200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07005999-1de4-472b-baa8-029019dc6f71 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:25.343302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11753-af8a-482e-a382-50e53722c0c3 None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:25.343302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11753-af8a-482e-a382-50e53722c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:25.343302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11753-af8a-482e-a382-50e53722c0c3 None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/f436ac7cc2f04919bb0ec1ad9fca5622/roles/f9846b0a2b8b45739e904a66fad55771` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:25.361115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11753-af8a-482e-a382-50e53722c0c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=f436ac7cc2f04919bb0ec1ad9fca5622, role_id=f9846b0a2b8b45739e904a66fad55771)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:25.362698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11753-af8a-482e-a382-50e53722c0c3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:25.412999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:25.447244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07005999-1de4-472b-baa8-029019dc6f71 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:25.459450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 297/598] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:36:25 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/f436ac7cc2f04919bb0ec1ad9fca5622/roles/f9846b0a2b8b45739e904a66fad55771 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:36:25.460573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe11753-af8a-482e-a382-50e53722c0c3 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:25.500595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6c926-1517-412d-87f7-e2700a395dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:25.501772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c926-1517-412d-87f7-e2700a395dff None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:25.503128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c926-1517-412d-87f7-e2700a395dff None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:25.503443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6c926-1517-412d-87f7-e2700a395dff None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/a3de64d734a04f9e9ab0d85e5c985e6a/roles/f9846b0a2b8b45739e904a66fad55771` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:25.522700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6c926-1517-412d-87f7-e2700a395dff None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=a3de64d734a04f9e9ab0d85e5c985e6a, role_id=f9846b0a2b8b45739e904a66fad55771)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:25.524278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6c926-1517-412d-87f7-e2700a395dff None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:25.569655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:25.579518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe11753-af8a-482e-a382-50e53722c0c3 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:25.616681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 302/599] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:36:25 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/a3de64d734a04f9e9ab0d85e5c985e6a/roles/f9846b0a2b8b45739e904a66fad55771 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:36:25.618171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6c926-1517-412d-87f7-e2700a395dff None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:25.638766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a18be-f1af-43b5-adf8-3e87f9c797df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:25.639693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a18be-f1af-43b5-adf8-3e87f9c797df None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:25.640524 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a18be-f1af-43b5-adf8-3e87f9c797df None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:25.641032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a18be-f1af-43b5-adf8-3e87f9c797df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:25.656063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a18be-f1af-43b5-adf8-3e87f9c797df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:25.658553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a18be-f1af-43b5-adf8-3e87f9c797df None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-197a18be-f1af-43b5-adf8-3e87f9c797df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:25.681256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:25.682377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:25.683687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:25.683687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:25.683687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:25.684958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 298/600] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:25.689863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a18be-f1af-43b5-adf8-3e87f9c797df None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:25.759566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6c926-1517-412d-87f7-e2700a395dff None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:25.779351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:25.818201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2716f-d3bb-4160-9b32-298a63a291b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:25.818789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2716f-d3bb-4160-9b32-298a63a291b4 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:25.819084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2716f-d3bb-4160-9b32-298a63a291b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:25.819393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2716f-d3bb-4160-9b32-298a63a291b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:25.826777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2716f-d3bb-4160-9b32-298a63a291b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:25.828269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2716f-d3bb-4160-9b32-298a63a291b4 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:25.833774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a18be-f1af-43b5-adf8-3e87f9c797df None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-e9f2716f-d3bb-4160-9b32-298a63a291b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:25.843148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:25.844095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:25.844950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:25.844950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:25.844950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:25.844950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:25.844950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:25.844950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:25.844950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:25.844950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:25.845372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 303/601] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:25.851629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2716f-d3bb-4160-9b32-298a63a291b4 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:25.882370 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37bece-b386-453a-b1ad-7f1a3b3545b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:25.883305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37bece-b386-453a-b1ad-7f1a3b3545b7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:25.883766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37bece-b386-453a-b1ad-7f1a3b3545b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:25.884237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37bece-b386-453a-b1ad-7f1a3b3545b7 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:25.885595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37bece-b386-453a-b1ad-7f1a3b3545b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:25.886101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37bece-b386-453a-b1ad-7f1a3b3545b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:25.888317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37bece-b386-453a-b1ad-7f1a3b3545b7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:25.905037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 299/602] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:25.912353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37bece-b386-453a-b1ad-7f1a3b3545b7 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:25.916329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:25.987781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2716f-d3bb-4160-9b32-298a63a291b4 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:26.030891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37bece-b386-453a-b1ad-7f1a3b3545b7 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:26.034180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9c12b-6783-4b53-8093-f843ec7331a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:26.036184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c12b-6783-4b53-8093-f843ec7331a1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:26.036839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c12b-6783-4b53-8093-f843ec7331a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:26.037403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c12b-6783-4b53-8093-f843ec7331a1 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:26.038329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c12b-6783-4b53-8093-f843ec7331a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:26.038837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c12b-6783-4b53-8093-f843ec7331a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:26.040510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c12b-6783-4b53-8093-f843ec7331a1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:26.061442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 304/603] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:26.067916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9c12b-6783-4b53-8093-f843ec7331a1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:26.079275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb92b6-2df5-490b-b9ad-3b9aee06864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:26.080459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb92b6-2df5-490b-b9ad-3b9aee06864d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:26.081623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb92b6-2df5-490b-b9ad-3b9aee06864d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:26.081623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb92b6-2df5-490b-b9ad-3b9aee06864d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:26.088839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb92b6-2df5-490b-b9ad-3b9aee06864d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:26.090413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb92b6-2df5-490b-b9ad-3b9aee06864d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-dcdb92b6-2df5-490b-b9ad-3b9aee06864d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:26.103409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:26.104316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:26.105191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:26.105191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:26.105191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:26.105191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:26.105191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:26.105191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:26.105191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:26.105191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:26.109246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 300/604] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:26.110465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb92b6-2df5-490b-b9ad-3b9aee06864d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:26.158236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:26.179139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:26.243799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb92b6-2df5-490b-b9ad-3b9aee06864d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:26.287336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9c12b-6783-4b53-8093-f843ec7331a1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:26.297652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1308c0-e9ac-4ea6-adc8-29b1d93f6739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:26.298260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1308c0-e9ac-4ea6-adc8-29b1d93f6739 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:26.299330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1308c0-e9ac-4ea6-adc8-29b1d93f6739 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:26.299434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1308c0-e9ac-4ea6-adc8-29b1d93f6739 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:26.300382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1308c0-e9ac-4ea6-adc8-29b1d93f6739 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:26.300697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1308c0-e9ac-4ea6-adc8-29b1d93f6739 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:26.302463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1308c0-e9ac-4ea6-adc8-29b1d93f6739 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:26.319431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 301/605] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:26.321801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1308c0-e9ac-4ea6-adc8-29b1d93f6739 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:26.357392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd504-9856-49b1-af62-d4f63e23c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:26.358427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd504-9856-49b1-af62-d4f63e23c3fc None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:26.358937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd504-9856-49b1-af62-d4f63e23c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:26.363319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd504-9856-49b1-af62-d4f63e23c3fc None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/a4403ef0835a4d658f8eb50fac0780eb/roles/f9846b0a2b8b45739e904a66fad55771` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:26.376129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dd504-9856-49b1-af62-d4f63e23c3fc None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=a4403ef0835a4d658f8eb50fac0780eb, role_id=f9846b0a2b8b45739e904a66fad55771)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:26.377851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dd504-9856-49b1-af62-d4f63e23c3fc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:26.453706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1308c0-e9ac-4ea6-adc8-29b1d93f6739 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:26.480301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:26.491872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4f919-49f9-455c-b1e6-fde8f4753709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:26.492532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4f919-49f9-455c-b1e6-fde8f4753709 None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:26.492921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4f919-49f9-455c-b1e6-fde8f4753709 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:26.493250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4f919-49f9-455c-b1e6-fde8f4753709 None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/7d8054e88916456991bf485c19f8b502/roles/f9846b0a2b8b45739e904a66fad55771` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:26.504398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 305/606] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:36:26 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/a4403ef0835a4d658f8eb50fac0780eb/roles/f9846b0a2b8b45739e904a66fad55771 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:36:26.512045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379d66a-39f3-4b20-8363-2b358b9ddea0 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:26.512394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379d66a-39f3-4b20-8363-2b358b9ddea0 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:26.512656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379d66a-39f3-4b20-8363-2b358b9ddea0 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:26.513428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4f919-49f9-455c-b1e6-fde8f4753709 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=7d8054e88916456991bf485c19f8b502, role_id=f9846b0a2b8b45739e904a66fad55771)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:26.515358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 306/607] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:26.519968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4f919-49f9-455c-b1e6-fde8f4753709 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:26.520901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd27d-cc5a-49c3-a82a-5300a0462124 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:26.521408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd27d-cc5a-49c3-a82a-5300a0462124 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:26.521919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd27d-cc5a-49c3-a82a-5300a0462124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:26.546596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-497bd27d-cc5a-49c3-a82a-5300a0462124 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:26.547754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-497bd27d-cc5a-49c3-a82a-5300a0462124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:26.619604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 302/608] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:36:26 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/7d8054e88916456991bf485c19f8b502/roles/f9846b0a2b8b45739e904a66fad55771 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:36:26.638786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 307/609] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:26.941325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4f919-49f9-455c-b1e6-fde8f4753709 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:27.060676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4f919-49f9-455c-b1e6-fde8f4753709 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:27.110213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b24fe-bd9d-4493-b78f-09ba64f495af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:27.110843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b24fe-bd9d-4493-b78f-09ba64f495af None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:27.111681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b24fe-bd9d-4493-b78f-09ba64f495af None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:27.112093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b24fe-bd9d-4493-b78f-09ba64f495af None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:27.124794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b24fe-bd9d-4493-b78f-09ba64f495af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-486b24fe-bd9d-4493-b78f-09ba64f495af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:27.129756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:27.130646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:27.131506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 303/610] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:27.137032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd27d-cc5a-49c3-a82a-5300a0462124 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:27.157082 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:27.261755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd27d-cc5a-49c3-a82a-5300a0462124 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:27.311161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e51d6-2637-406a-aeec-38a78cd7c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:27.311804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e51d6-2637-406a-aeec-38a78cd7c398 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:27.312096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e51d6-2637-406a-aeec-38a78cd7c398 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:27.312372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e51d6-2637-406a-aeec-38a78cd7c398 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:27.313046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e51d6-2637-406a-aeec-38a78cd7c398 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:27.313350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e51d6-2637-406a-aeec-38a78cd7c398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:27.315521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e51d6-2637-406a-aeec-38a78cd7c398 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:27.323877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 308/611] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:27.329137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b24fe-bd9d-4493-b78f-09ba64f495af None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:27.399657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:27.505631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b24fe-bd9d-4493-b78f-09ba64f495af None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:27.550560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3ac46-6d3b-41a8-ad2a-a886e16ed4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:27.551547 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ac46-6d3b-41a8-ad2a-a886e16ed4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:27.552276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ac46-6d3b-41a8-ad2a-a886e16ed4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:27.552777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ac46-6d3b-41a8-ad2a-a886e16ed4b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:27.572014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3ac46-6d3b-41a8-ad2a-a886e16ed4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:27.573864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3ac46-6d3b-41a8-ad2a-a886e16ed4b3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-38c3ac46-6d3b-41a8-ad2a-a886e16ed4b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:27.595062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:27.596822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:27.597689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:27.597689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:27.597689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:27.599820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 304/612] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:27.605196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e51d6-2637-406a-aeec-38a78cd7c398 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:27.727471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:27.753140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e51d6-2637-406a-aeec-38a78cd7c398 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:27.797839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca6868-a2f6-45e5-86b3-b562e120b6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:27.798454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca6868-a2f6-45e5-86b3-b562e120b6ae None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:27.799790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca6868-a2f6-45e5-86b3-b562e120b6ae None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:27.799790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca6868-a2f6-45e5-86b3-b562e120b6ae None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:27.800367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca6868-a2f6-45e5-86b3-b562e120b6ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:27.800727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca6868-a2f6-45e5-86b3-b562e120b6ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:27.802317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca6868-a2f6-45e5-86b3-b562e120b6ae None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:27.820632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 309/613] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:27.825835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3ac46-6d3b-41a8-ad2a-a886e16ed4b3 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:27.958377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:27.965126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814f8e-7168-4c91-9c66-73053740aa69 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:27.965330 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814f8e-7168-4c91-9c66-73053740aa69 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:27.965615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814f8e-7168-4c91-9c66-73053740aa69 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:27.967239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 310/614] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:27.977364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19405c98-3caf-4b29-8e63-b21ac3dfa8f2 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:27.977650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19405c98-3caf-4b29-8e63-b21ac3dfa8f2 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:27.977929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19405c98-3caf-4b29-8e63-b21ac3dfa8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:27.978656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3ac46-6d3b-41a8-ad2a-a886e16ed4b3 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:28.017054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac597-2483-4de9-8f3c-a1ca8d5dcd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:28.018035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac597-2483-4de9-8f3c-a1ca8d5dcd9d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:28.018463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac597-2483-4de9-8f3c-a1ca8d5dcd9d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:28.018871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac597-2483-4de9-8f3c-a1ca8d5dcd9d None admin] PATH_INFO: `/v3/users/swift` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:28.020294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-19405c98-3caf-4b29-8e63-b21ac3dfa8f2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:28.021522 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-19405c98-3caf-4b29-8e63-b21ac3dfa8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:28.027458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ac597-2483-4de9-8f3c-a1ca8d5dcd9d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:28.029121 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ac597-2483-4de9-8f3c-a1ca8d5dcd9d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-1c4ac597-2483-4de9-8f3c-a1ca8d5dcd9d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:28.042184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:28.043384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:28.044586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:28.046782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 305/615] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:28.052930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac597-2483-4de9-8f3c-a1ca8d5dcd9d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:28.161639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac597-2483-4de9-8f3c-a1ca8d5dcd9d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:28.190427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 311/616] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:28.196145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f905c-8489-4e0f-981a-a9c9d25281b9 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:28.196436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f905c-8489-4e0f-981a-a9c9d25281b9 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:28.196729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f905c-8489-4e0f-981a-a9c9d25281b9 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:28.198094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 312/617] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:28.207566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3321-77cd-419d-944c-4a94278bd3ec None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:28.207905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3321-77cd-419d-944c-4a94278bd3ec None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:28.208136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3321-77cd-419d-944c-4a94278bd3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:28.216444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b9e89-eafc-4d60-8334-cf3a41ad2e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:28.217064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9e89-eafc-4d60-8334-cf3a41ad2e7d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:28.217345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9e89-eafc-4d60-8334-cf3a41ad2e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:28.217622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9e89-eafc-4d60-8334-cf3a41ad2e7d None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:28.218359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b9e89-eafc-4d60-8334-cf3a41ad2e7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:28.218665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b9e89-eafc-4d60-8334-cf3a41ad2e7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:28.222244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b9e89-eafc-4d60-8334-cf3a41ad2e7d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:28.240272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-69dd3321-77cd-419d-944c-4a94278bd3ec None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:28.241472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-69dd3321-77cd-419d-944c-4a94278bd3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:28.258778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 306/618] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 07:36:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:28.266344 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b9e89-eafc-4d60-8334-cf3a41ad2e7d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:28.271759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:28.363690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:28.369061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 313/619] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:28.395237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b9e89-eafc-4d60-8334-cf3a41ad2e7d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:28.463449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab8b6-c4d7-4c5e-8fdf-f79b930f2a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:28.464083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab8b6-c4d7-4c5e-8fdf-f79b930f2a79 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:28.464365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab8b6-c4d7-4c5e-8fdf-f79b930f2a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:28.464649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ab8b6-c4d7-4c5e-8fdf-f79b930f2a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:28.482939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ab8b6-c4d7-4c5e-8fdf-f79b930f2a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:28.484416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ab8b6-c4d7-4c5e-8fdf-f79b930f2a79 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-542ab8b6-c4d7-4c5e-8fdf-f79b930f2a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:28.505617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:28.506587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:28.507646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:28.507646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:28.507646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:28.507646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 307/620] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:28.512376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd3321-77cd-419d-944c-4a94278bd3ec None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:28.607920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab8b6-c4d7-4c5e-8fdf-f79b930f2a79 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:28.631916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd3321-77cd-419d-944c-4a94278bd3ec None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:28.670242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ed32-f99a-439a-b2dc-fb4ab03d9a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:28.670862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ed32-f99a-439a-b2dc-fb4ab03d9a0d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:28.671143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ed32-f99a-439a-b2dc-fb4ab03d9a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:28.671471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ed32-f99a-439a-b2dc-fb4ab03d9a0d None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:28.672123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0ed32-f99a-439a-b2dc-fb4ab03d9a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:28.672425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0ed32-f99a-439a-b2dc-fb4ab03d9a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:28.675603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0ed32-f99a-439a-b2dc-fb4ab03d9a0d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:28.687176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 314/621] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:28.699449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ed32-f99a-439a-b2dc-fb4ab03d9a0d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:28.707696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:28.754515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ab8b6-c4d7-4c5e-8fdf-f79b930f2a79 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:28.791321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c720b4f-c04d-4739-98c9-fd294eb21aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:28.792138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:28.793636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c720b4f-c04d-4739-98c9-fd294eb21aa2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:28.794220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c720b4f-c04d-4739-98c9-fd294eb21aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:28.794664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c720b4f-c04d-4739-98c9-fd294eb21aa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:28.806506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c720b4f-c04d-4739-98c9-fd294eb21aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-1c720b4f-c04d-4739-98c9-fd294eb21aa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:28.812160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:28.813075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:28.813923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:28.817147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 308/622] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:28.818168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c720b4f-c04d-4739-98c9-fd294eb21aa2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:28.818989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ed32-f99a-439a-b2dc-fb4ab03d9a0d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:28.858145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2a43-7c19-45a4-821c-3bfe7a062ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:28.859195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2a43-7c19-45a4-821c-3bfe7a062ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:28.859195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2a43-7c19-45a4-821c-3bfe7a062ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:28.859566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2a43-7c19-45a4-821c-3bfe7a062ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:28.867682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2a43-7c19-45a4-821c-3bfe7a062ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:28.869345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2a43-7c19-45a4-821c-3bfe7a062ac9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-f3ba2a43-7c19-45a4-821c-3bfe7a062ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:28.883085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:28.884126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:28.884979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:28.884979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:28.884979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:28.884979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:28.884979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:28.884979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:28.884979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:28.884979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:28.884979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 315/623] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:28.885490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2a43-7c19-45a4-821c-3bfe7a062ac9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:28.935660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c720b4f-c04d-4739-98c9-fd294eb21aa2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:28.953903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:28.974060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e4b0c-ce04-4caf-9ab9-03850ddcedee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:28.975128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e4b0c-ce04-4caf-9ab9-03850ddcedee None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:28.975603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e4b0c-ce04-4caf-9ab9-03850ddcedee None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:28.976047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e4b0c-ce04-4caf-9ab9-03850ddcedee None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:28.989060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e4b0c-ce04-4caf-9ab9-03850ddcedee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-593e4b0c-ce04-4caf-9ab9-03850ddcedee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:28.995159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:28.996068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:28.996878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:28.998695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 309/624] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:28.998939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2a43-7c19-45a4-821c-3bfe7a062ac9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:28.999900 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e4b0c-ce04-4caf-9ab9-03850ddcedee None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.024949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:29.040410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35c609-a511-4f60-8166-78473d489107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.041270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c609-a511-4f60-8166-78473d489107 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.041716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c609-a511-4f60-8166-78473d489107 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.042126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c609-a511-4f60-8166-78473d489107 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.043048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35c609-a511-4f60-8166-78473d489107 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:29.043563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35c609-a511-4f60-8166-78473d489107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:29.045164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35c609-a511-4f60-8166-78473d489107 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:29.056954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 316/625] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:29.058354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf854b0-4879-4edb-a229-281fdf54bdb5 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.058645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf854b0-4879-4edb-a229-281fdf54bdb5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.058912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf854b0-4879-4edb-a229-281fdf54bdb5 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.060336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 317/626] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:29.060881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf854b0-4879-4edb-a229-281fdf54bdb5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.114713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e4b0c-ce04-4caf-9ab9-03850ddcedee None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:29.149700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab8f31-eb0a-4b54-b632-23c7e5e66226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.150219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab8f31-eb0a-4b54-b632-23c7e5e66226 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.150493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab8f31-eb0a-4b54-b632-23c7e5e66226 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.150762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab8f31-eb0a-4b54-b632-23c7e5e66226 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.151475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab8f31-eb0a-4b54-b632-23c7e5e66226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:29.151778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab8f31-eb0a-4b54-b632-23c7e5e66226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:29.153195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab8f31-eb0a-4b54-b632-23c7e5e66226 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:29.165356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 310/627] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:29.168432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab8f31-eb0a-4b54-b632-23c7e5e66226 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.169386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf854b0-4879-4edb-a229-281fdf54bdb5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:29.204350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81d052-7b67-4950-9f60-86b1b5b8a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.204544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:29.205198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81d052-7b67-4950-9f60-86b1b5b8a026 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.205617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81d052-7b67-4950-9f60-86b1b5b8a026 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.205887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81d052-7b67-4950-9f60-86b1b5b8a026 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.206542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81d052-7b67-4950-9f60-86b1b5b8a026 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:29.206840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81d052-7b67-4950-9f60-86b1b5b8a026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:29.208220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81d052-7b67-4950-9f60-86b1b5b8a026 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:29.216128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 318/628] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:29.217376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b971393-0e5c-4f74-9572-031bf4250c63 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.217669 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b971393-0e5c-4f74-9572-031bf4250c63 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.218846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b971393-0e5c-4f74-9572-031bf4250c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.235190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8b971393-0e5c-4f74-9572-031bf4250c63 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:29.237008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8b971393-0e5c-4f74-9572-031bf4250c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:29.268901 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab8f31-eb0a-4b54-b632-23c7e5e66226 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:29.275544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:29.302264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb786-cd14-4539-9878-a215e2b15e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.302771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 319/629] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:29.302894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb786-cd14-4539-9878-a215e2b15e7a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.303148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb786-cd14-4539-9878-a215e2b15e7a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.303446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb786-cd14-4539-9878-a215e2b15e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.304144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b954-ee27-4795-ad45-2cce945cbc80 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.304397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b954-ee27-4795-ad45-2cce945cbc80 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.304679 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b954-ee27-4795-ad45-2cce945cbc80 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.305920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 320/630] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:29.306606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b954-ee27-4795-ad45-2cce945cbc80 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.323857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeb786-cd14-4539-9878-a215e2b15e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:29.325298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeb786-cd14-4539-9878-a215e2b15e7a None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-0eaeb786-cd14-4539-9878-a215e2b15e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:29.341377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:29.342399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:29.343250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:29.343250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:29.343250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:29.347986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 311/631] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:29.348774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb786-cd14-4539-9878-a215e2b15e7a None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.422131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b954-ee27-4795-ad45-2cce945cbc80 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:29.437573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:29.450161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb786-cd14-4539-9878-a215e2b15e7a None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:29.458763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6c83-6d44-4093-a2e3-7e4f0b90f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.459528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6c83-6d44-4093-a2e3-7e4f0b90f1a7 None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.459814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6c83-6d44-4093-a2e3-7e4f0b90f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.460095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6c83-6d44-4093-a2e3-7e4f0b90f1a7 None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/15d9847a3a5048efb19e507f988e37f4/roles/f9846b0a2b8b45739e904a66fad55771` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.475333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a6c83-6d44-4093-a2e3-7e4f0b90f1a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=15d9847a3a5048efb19e507f988e37f4, role_id=f9846b0a2b8b45739e904a66fad55771)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:29.476790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a6c83-6d44-4093-a2e3-7e4f0b90f1a7 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:29.487816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f539c-a24c-429d-a490-2048a19d916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.488426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f539c-a24c-429d-a490-2048a19d916d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.488704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f539c-a24c-429d-a490-2048a19d916d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.488970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f539c-a24c-429d-a490-2048a19d916d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.498849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f539c-a24c-429d-a490-2048a19d916d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:29.500436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f539c-a24c-429d-a490-2048a19d916d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-5b0f539c-a24c-429d-a490-2048a19d916d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:29.516068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:29.517035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:29.518614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:29.518614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:29.518614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:29.522444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 312/632] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:29.523715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e232f-3ae9-483a-b954-28a340595bb9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.528630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e232f-3ae9-483a-b954-28a340595bb9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.528753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 321/633] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:36:29 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/15d9847a3a5048efb19e507f988e37f4/roles/f9846b0a2b8b45739e904a66fad55771 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:36:29.528843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e232f-3ae9-483a-b954-28a340595bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.528936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6c83-6d44-4093-a2e3-7e4f0b90f1a7 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.547282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1a1e232f-3ae9-483a-b954-28a340595bb9 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:29.549053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1a1e232f-3ae9-483a-b954-28a340595bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:29.561277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:29.626246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 313/634] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:29.627709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e232f-3ae9-483a-b954-28a340595bb9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.646494 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6c83-6d44-4093-a2e3-7e4f0b90f1a7 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:29.698341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03954147-f407-4775-a9dd-dc16c93a1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.698893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03954147-f407-4775-a9dd-dc16c93a1141 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.699184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03954147-f407-4775-a9dd-dc16c93a1141 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.699487 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03954147-f407-4775-a9dd-dc16c93a1141 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.700137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03954147-f407-4775-a9dd-dc16c93a1141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:29.700440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03954147-f407-4775-a9dd-dc16c93a1141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:29.701847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03954147-f407-4775-a9dd-dc16c93a1141 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:29.714807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 322/635] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:29.715759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03954147-f407-4775-a9dd-dc16c93a1141 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.725404 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:29.759945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e232f-3ae9-483a-b954-28a340595bb9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:29.798964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91d3dc-af84-4c6f-8ad3-38685cc30c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.799709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91d3dc-af84-4c6f-8ad3-38685cc30c6d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.799998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91d3dc-af84-4c6f-8ad3-38685cc30c6d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.800275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91d3dc-af84-4c6f-8ad3-38685cc30c6d None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.801088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91d3dc-af84-4c6f-8ad3-38685cc30c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:29.801397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91d3dc-af84-4c6f-8ad3-38685cc30c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:29.803014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91d3dc-af84-4c6f-8ad3-38685cc30c6d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:29.807246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:29.816247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 314/636] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:29.817099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91d3dc-af84-4c6f-8ad3-38685cc30c6d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.827924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03954147-f407-4775-a9dd-dc16c93a1141 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:29.864416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d814-a417-44a6-ae3a-a05bab42fee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.865055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d814-a417-44a6-ae3a-a05bab42fee5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.865478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d814-a417-44a6-ae3a-a05bab42fee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.865752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d814-a417-44a6-ae3a-a05bab42fee5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.876265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9d814-a417-44a6-ae3a-a05bab42fee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-b8e9d814-a417-44a6-ae3a-a05bab42fee5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:29.882302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:29.883220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 323/637] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:29.884690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d814-a417-44a6-ae3a-a05bab42fee5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.929180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91d3dc-af84-4c6f-8ad3-38685cc30c6d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:29.959595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:29.965646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31151d-db55-4c51-8017-179c0c9c1aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:29.966270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31151d-db55-4c51-8017-179c0c9c1aca None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:29.966544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31151d-db55-4c51-8017-179c0c9c1aca None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:29.967032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31151d-db55-4c51-8017-179c0c9c1aca None admin] PATH_INFO: `/v3/users/glance` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:29.974920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31151d-db55-4c51-8017-179c0c9c1aca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:29.976506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31151d-db55-4c51-8017-179c0c9c1aca None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-9a31151d-db55-4c51-8017-179c0c9c1aca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:29.988634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:29.989621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 315/638] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:29.990613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31151d-db55-4c51-8017-179c0c9c1aca None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:29.997951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d814-a417-44a6-ae3a-a05bab42fee5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.036479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e7ba9-570a-448e-b2b6-b6f34a99148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.037365 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e7ba9-570a-448e-b2b6-b6f34a99148a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.037655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e7ba9-570a-448e-b2b6-b6f34a99148a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.037934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e7ba9-570a-448e-b2b6-b6f34a99148a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.046399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e7ba9-570a-448e-b2b6-b6f34a99148a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:30.048167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e7ba9-570a-448e-b2b6-b6f34a99148a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-491e7ba9-570a-448e-b2b6-b6f34a99148a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:30.060860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:30.061894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:36:30.062835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:30.067018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 324/639] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:30.067919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e7ba9-570a-448e-b2b6-b6f34a99148a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:30.071510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:30.101393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31151d-db55-4c51-8017-179c0c9c1aca None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.136010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d02737-b9c0-4a05-9028-7e2715e52d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.136609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d02737-b9c0-4a05-9028-7e2715e52d5d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.136888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d02737-b9c0-4a05-9028-7e2715e52d5d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.137161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d02737-b9c0-4a05-9028-7e2715e52d5d None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.137818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d02737-b9c0-4a05-9028-7e2715e52d5d None admin] RBAC: Adding query filter params (name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:30.138118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d02737-b9c0-4a05-9028-7e2715e52d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:30.139505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d02737-b9c0-4a05-9028-7e2715e52d5d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:30.148428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 316/640] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:30.149049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d02737-b9c0-4a05-9028-7e2715e52d5d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:30.179063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e7ba9-570a-448e-b2b6-b6f34a99148a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.204467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:30.216154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd42f7-2669-4665-b530-bfbe5b880fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.216716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd42f7-2669-4665-b530-bfbe5b880fe8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.217138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd42f7-2669-4665-b530-bfbe5b880fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.217416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd42f7-2669-4665-b530-bfbe5b880fe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.229142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd42f7-2669-4665-b530-bfbe5b880fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-ebbd42f7-2669-4665-b530-bfbe5b880fe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:30.234457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:30.235493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 325/641] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:30.240295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd42f7-2669-4665-b530-bfbe5b880fe8 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:30.262754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d02737-b9c0-4a05-9028-7e2715e52d5d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.299528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:30.302026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fc095-bf72-45aa-b549-b8d25a2ab6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.302635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fc095-bf72-45aa-b549-b8d25a2ab6ca None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.302917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fc095-bf72-45aa-b549-b8d25a2ab6ca None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.303190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fc095-bf72-45aa-b549-b8d25a2ab6ca None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.303943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fc095-bf72-45aa-b549-b8d25a2ab6ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:30.304249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fc095-bf72-45aa-b549-b8d25a2ab6ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:30.305688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fc095-bf72-45aa-b549-b8d25a2ab6ca None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:30.327862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 317/642] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 07:36:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:30.327862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fc095-bf72-45aa-b549-b8d25a2ab6ca None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:30.342879 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd42f7-2669-4665-b530-bfbe5b880fe8 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.382843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed270a-adcf-4796-b5b1-b6b5f16d116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.383571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed270a-adcf-4796-b5b1-b6b5f16d116c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.383939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed270a-adcf-4796-b5b1-b6b5f16d116c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.384282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed270a-adcf-4796-b5b1-b6b5f16d116c None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.385018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed270a-adcf-4796-b5b1-b6b5f16d116c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:30.385325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed270a-adcf-4796-b5b1-b6b5f16d116c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:30.386752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed270a-adcf-4796-b5b1-b6b5f16d116c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:30.409116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 326/643] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 24 07:36:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:30.409116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed270a-adcf-4796-b5b1-b6b5f16d116c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:30.443161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fc095-bf72-45aa-b549-b8d25a2ab6ca None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.454246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:30.481878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5032769-8bef-4b23-b885-599c4e7d45e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.482505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032769-8bef-4b23-b885-599c4e7d45e8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.482788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032769-8bef-4b23-b885-599c4e7d45e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.483063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5032769-8bef-4b23-b885-599c4e7d45e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.494896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5032769-8bef-4b23-b885-599c4e7d45e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:30.496363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5032769-8bef-4b23-b885-599c4e7d45e8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:30.509665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed270a-adcf-4796-b5b1-b6b5f16d116c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-f5032769-8bef-4b23-b885-599c4e7d45e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:30.511838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:30.512751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:30.513813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:30.513813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:30.513813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:30.513813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 318/644] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:30.513813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5032769-8bef-4b23-b885-599c4e7d45e8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:30.541283 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:30.554946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc152f30-7b9f-46bd-8e59-c3a292572682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.555584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc152f30-7b9f-46bd-8e59-c3a292572682 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.555876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc152f30-7b9f-46bd-8e59-c3a292572682 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.556270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc152f30-7b9f-46bd-8e59-c3a292572682 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.556944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc152f30-7b9f-46bd-8e59-c3a292572682 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:30.557249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc152f30-7b9f-46bd-8e59-c3a292572682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:30.558820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc152f30-7b9f-46bd-8e59-c3a292572682 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:30.572034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 327/645] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:30.572034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc152f30-7b9f-46bd-8e59-c3a292572682 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:30.620920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5032769-8bef-4b23-b885-599c4e7d45e8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.657190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d563e-793f-41af-a19f-0667e66298b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.657921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d563e-793f-41af-a19f-0667e66298b8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.658295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d563e-793f-41af-a19f-0667e66298b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.658480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d563e-793f-41af-a19f-0667e66298b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.681964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc152f30-7b9f-46bd-8e59-c3a292572682 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.689363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:30.721143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc37127-e0cd-47a3-b86b-5bf84ecf1938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.722278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc37127-e0cd-47a3-b86b-5bf84ecf1938 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.722744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc37127-e0cd-47a3-b86b-5bf84ecf1938 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.723225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc37127-e0cd-47a3-b86b-5bf84ecf1938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.731873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d563e-793f-41af-a19f-0667e66298b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:30.733384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d563e-793f-41af-a19f-0667e66298b8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:30.777916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:30.794872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc37127-e0cd-47a3-b86b-5bf84ecf1938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:30.796374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc37127-e0cd-47a3-b86b-5bf84ecf1938 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:30.846945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 319/646] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:30.846945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d563e-793f-41af-a19f-0667e66298b8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:30.909483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:30.916294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 328/647] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:30.916294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc37127-e0cd-47a3-b86b-5bf84ecf1938 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:30.954419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d563e-793f-41af-a19f-0667e66298b8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:30.990669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29fe6-abc9-42c6-a7f0-7301bd426b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:30.991200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29fe6-abc9-42c6-a7f0-7301bd426b58 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:30.991511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29fe6-abc9-42c6-a7f0-7301bd426b58 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:30.991787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db29fe6-abc9-42c6-a7f0-7301bd426b58 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:30.992430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db29fe6-abc9-42c6-a7f0-7301bd426b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:30.992735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db29fe6-abc9-42c6-a7f0-7301bd426b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:30.994109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db29fe6-abc9-42c6-a7f0-7301bd426b58 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.006855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 320/648] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:31.007714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29fe6-abc9-42c6-a7f0-7301bd426b58 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.014629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:31.034345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc37127-e0cd-47a3-b86b-5bf84ecf1938 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.073398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654d9f-f43a-4ed0-b9cc-537cd9856793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.074421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654d9f-f43a-4ed0-b9cc-537cd9856793 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.075148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654d9f-f43a-4ed0-b9cc-537cd9856793 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.075757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a654d9f-f43a-4ed0-b9cc-537cd9856793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.089608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a654d9f-f43a-4ed0-b9cc-537cd9856793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.092111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a654d9f-f43a-4ed0-b9cc-537cd9856793 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-1a654d9f-f43a-4ed0-b9cc-537cd9856793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:31.110555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:31.112400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:31.113457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:31.113457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:31.113457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:31.113457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 329/649] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:31.113693 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654d9f-f43a-4ed0-b9cc-537cd9856793 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.119254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db29fe6-abc9-42c6-a7f0-7301bd426b58 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.143553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:31.155439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5569d1-ce96-40a6-adff-3dec60d6d2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.156526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5569d1-ce96-40a6-adff-3dec60d6d2ac None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.156633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5569d1-ce96-40a6-adff-3dec60d6d2ac None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.156844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5569d1-ce96-40a6-adff-3dec60d6d2ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.168542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5569d1-ce96-40a6-adff-3dec60d6d2ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.170002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5569d1-ce96-40a6-adff-3dec60d6d2ac None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-4c5569d1-ce96-40a6-adff-3dec60d6d2ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:31.187037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:31.188076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:31.189004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:31.189004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:31.189004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:31.189004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 321/650] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:31.189004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5569d1-ce96-40a6-adff-3dec60d6d2ac None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.228146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a654d9f-f43a-4ed0-b9cc-537cd9856793 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.265224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747bb9-da69-4911-9cb5-cd011f534a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.266181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747bb9-da69-4911-9cb5-cd011f534a44 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.266752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747bb9-da69-4911-9cb5-cd011f534a44 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.267308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747bb9-da69-4911-9cb5-cd011f534a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.270475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:31.279547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68747bb9-da69-4911-9cb5-cd011f534a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.281152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68747bb9-da69-4911-9cb5-cd011f534a44 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.293068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5569d1-ce96-40a6-adff-3dec60d6d2ac None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-68747bb9-da69-4911-9cb5-cd011f534a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:31.296610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:31.297701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:31.298707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:31.298707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:31.298707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:31.302858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 330/651] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:31.303745 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747bb9-da69-4911-9cb5-cd011f534a44 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.328081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0245cb-2612-44f1-9e18-8ee011f52e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.328761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0245cb-2612-44f1-9e18-8ee011f52e16 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.328988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0245cb-2612-44f1-9e18-8ee011f52e16 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.329260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0245cb-2612-44f1-9e18-8ee011f52e16 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.339443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0245cb-2612-44f1-9e18-8ee011f52e16 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.340893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0245cb-2612-44f1-9e18-8ee011f52e16 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-da0245cb-2612-44f1-9e18-8ee011f52e16 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:31.355181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:31.356146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:36:31.357100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:31.361713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 322/652] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:31.362582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0245cb-2612-44f1-9e18-8ee011f52e16 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.400840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:31.416348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747bb9-da69-4911-9cb5-cd011f534a44 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.457978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504d7af-8084-41dd-985f-1eb8969344b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.458870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504d7af-8084-41dd-985f-1eb8969344b3 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.459168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504d7af-8084-41dd-985f-1eb8969344b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.459471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504d7af-8084-41dd-985f-1eb8969344b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.460287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504d7af-8084-41dd-985f-1eb8969344b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:31.460597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504d7af-8084-41dd-985f-1eb8969344b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.462541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504d7af-8084-41dd-985f-1eb8969344b3 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.469273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0245cb-2612-44f1-9e18-8ee011f52e16 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.476867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 331/653] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:31.478120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504d7af-8084-41dd-985f-1eb8969344b3 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.505221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c5daa-df13-4222-898e-56f5d290106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.505832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c5daa-df13-4222-898e-56f5d290106e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.506110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c5daa-df13-4222-898e-56f5d290106e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.506383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c5daa-df13-4222-898e-56f5d290106e None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.507018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c5daa-df13-4222-898e-56f5d290106e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:31.507344 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c5daa-df13-4222-898e-56f5d290106e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.508697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c5daa-df13-4222-898e-56f5d290106e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.519900 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 323/654] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:31.520622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c5daa-df13-4222-898e-56f5d290106e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.531700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:31.582059 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504d7af-8084-41dd-985f-1eb8969344b3 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.612030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:31.615470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1d9f1-3cb4-4b8d-8827-72494d2558cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.616078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1d9f1-3cb4-4b8d-8827-72494d2558cc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.616357 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1d9f1-3cb4-4b8d-8827-72494d2558cc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.616630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1d9f1-3cb4-4b8d-8827-72494d2558cc None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.617266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1d9f1-3cb4-4b8d-8827-72494d2558cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:31.617567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1d9f1-3cb4-4b8d-8827-72494d2558cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.618500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c5daa-df13-4222-898e-56f5d290106e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.618920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1d9f1-3cb4-4b8d-8827-72494d2558cc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.630181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 332/655] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:31.631408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02b9bf-8039-4f09-a128-e239a544c5c4 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.631694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02b9bf-8039-4f09-a128-e239a544c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.631966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02b9bf-8039-4f09-a128-e239a544c5c4 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.633172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 333/656] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:31.633866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02b9bf-8039-4f09-a128-e239a544c5c4 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.655613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca52ca9-0c28-43c6-94c5-90c716b52ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.656214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca52ca9-0c28-43c6-94c5-90c716b52ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.656491 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca52ca9-0c28-43c6-94c5-90c716b52ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.656763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca52ca9-0c28-43c6-94c5-90c716b52ee3 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.657477 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca52ca9-0c28-43c6-94c5-90c716b52ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:31.658369 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca52ca9-0c28-43c6-94c5-90c716b52ee3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.659875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca52ca9-0c28-43c6-94c5-90c716b52ee3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.676424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 324/657] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:31.677466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca52ca9-0c28-43c6-94c5-90c716b52ee3 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.735109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02b9bf-8039-4f09-a128-e239a544c5c4 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.744202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:31.768277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9023eb5-a627-47fb-89dd-d2c991b49415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.769026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9023eb5-a627-47fb-89dd-d2c991b49415 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.769320 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9023eb5-a627-47fb-89dd-d2c991b49415 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.769601 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9023eb5-a627-47fb-89dd-d2c991b49415 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.775403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca52ca9-0c28-43c6-94c5-90c716b52ee3 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.777432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9023eb5-a627-47fb-89dd-d2c991b49415 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.778866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9023eb5-a627-47fb-89dd-d2c991b49415 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-f9023eb5-a627-47fb-89dd-d2c991b49415 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:31.790396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:31.791400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 334/658] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:31.792398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9023eb5-a627-47fb-89dd-d2c991b49415 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.814992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e0c69-9cc5-4ffd-b422-e6d448f34bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.815657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e0c69-9cc5-4ffd-b422-e6d448f34bb1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.815939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e0c69-9cc5-4ffd-b422-e6d448f34bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.816221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e0c69-9cc5-4ffd-b422-e6d448f34bb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.822795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e0c69-9cc5-4ffd-b422-e6d448f34bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.824253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e0c69-9cc5-4ffd-b422-e6d448f34bb1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-250e0c69-9cc5-4ffd-b422-e6d448f34bb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:31.835188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:31.836134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:31.837176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:31.837176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:31.837176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:31.837176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:31.837176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:31.837176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:31.837176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:31.837176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:31.837176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 325/659] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:31.838211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f207f-2aad-4793-a04a-780c5d011b48 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.838211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f207f-2aad-4793-a04a-780c5d011b48 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.838374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f207f-2aad-4793-a04a-780c5d011b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.855585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-fa9f207f-2aad-4793-a04a-780c5d011b48 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:31.856777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fa9f207f-2aad-4793-a04a-780c5d011b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:31.864129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:31.896050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9023eb5-a627-47fb-89dd-d2c991b49415 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:31.922107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 326/660] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:31.923202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f207f-2aad-4793-a04a-780c5d011b48 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.930764 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c824c9-c28b-42e7-93f9-1147f622ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:31.931470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c824c9-c28b-42e7-93f9-1147f622ea82 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:31.931751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c824c9-c28b-42e7-93f9-1147f622ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:31.932020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c824c9-c28b-42e7-93f9-1147f622ea82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:31.938625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c824c9-c28b-42e7-93f9-1147f622ea82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:31.940614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c824c9-c28b-42e7-93f9-1147f622ea82 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-77c824c9-c28b-42e7-93f9-1147f622ea82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:31.953427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:31.954309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:31.955961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:31.955961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:31.955961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:31.955961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:31.955961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:31.955961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:31.955961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:31.955961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:31.958693 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 335/661] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:31.959704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c824c9-c28b-42e7-93f9-1147f622ea82 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:31.990142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:32.036652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f207f-2aad-4793-a04a-780c5d011b48 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:32.070311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c824c9-c28b-42e7-93f9-1147f622ea82 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:32.073920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64945273-dae2-4794-9e2f-b4c816319fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:32.074549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64945273-dae2-4794-9e2f-b4c816319fbc None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:32.074827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64945273-dae2-4794-9e2f-b4c816319fbc None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:32.075091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64945273-dae2-4794-9e2f-b4c816319fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:32.088338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:32.104139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688e683-9a48-45db-9ebc-369d22e57f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:32.104736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688e683-9a48-45db-9ebc-369d22e57f47 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:32.105018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688e683-9a48-45db-9ebc-369d22e57f47 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:32.105298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688e683-9a48-45db-9ebc-369d22e57f47 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:32.106031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688e683-9a48-45db-9ebc-369d22e57f47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:32.106338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688e683-9a48-45db-9ebc-369d22e57f47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:32.107803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688e683-9a48-45db-9ebc-369d22e57f47 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:32.130542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 336/662] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:32.130542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688e683-9a48-45db-9ebc-369d22e57f47 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:32.151788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64945273-dae2-4794-9e2f-b4c816319fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:32.153526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64945273-dae2-4794-9e2f-b4c816319fbc None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:32.212967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:32.227798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688e683-9a48-45db-9ebc-369d22e57f47 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:32.256627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 327/663] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:32.257470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64945273-dae2-4794-9e2f-b4c816319fbc None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:32.266607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742e27-7831-45b0-938f-ec41882a0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:32.267449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742e27-7831-45b0-938f-ec41882a0fdf None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:32.267868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742e27-7831-45b0-938f-ec41882a0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:32.268140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742e27-7831-45b0-938f-ec41882a0fdf None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:32.268830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742e27-7831-45b0-938f-ec41882a0fdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:32.269136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742e27-7831-45b0-938f-ec41882a0fdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:32.270571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742e27-7831-45b0-938f-ec41882a0fdf None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:32.281972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 337/664] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:32.282824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742e27-7831-45b0-938f-ec41882a0fdf None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:32.306962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:32.365240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64945273-dae2-4794-9e2f-b4c816319fbc None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:32.382010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742e27-7831-45b0-938f-ec41882a0fdf None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:32.418523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f509da-3979-45fa-99d9-eef4635c4950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:32.419147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f509da-3979-45fa-99d9-eef4635c4950 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:32.419464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f509da-3979-45fa-99d9-eef4635c4950 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:32.419739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f509da-3979-45fa-99d9-eef4635c4950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:32.436990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:32.491906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f509da-3979-45fa-99d9-eef4635c4950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:32.493352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f509da-3979-45fa-99d9-eef4635c4950 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:32.512686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d66ab7-8866-49ef-8c54-2bc88d6c239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:32.513281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d66ab7-8866-49ef-8c54-2bc88d6c239e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:32.513551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d66ab7-8866-49ef-8c54-2bc88d6c239e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:32.513816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d66ab7-8866-49ef-8c54-2bc88d6c239e None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:32.514492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d66ab7-8866-49ef-8c54-2bc88d6c239e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:32.514786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d66ab7-8866-49ef-8c54-2bc88d6c239e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:32.516217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d66ab7-8866-49ef-8c54-2bc88d6c239e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:32.528488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 328/665] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:32.529269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d66ab7-8866-49ef-8c54-2bc88d6c239e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:32.590922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 338/666] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:32.591728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f509da-3979-45fa-99d9-eef4635c4950 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:32.626281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d66ab7-8866-49ef-8c54-2bc88d6c239e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:32.627811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:32.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:32.660153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149c20-0904-4474-92c2-f977a0f7cacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:32.660775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149c20-0904-4474-92c2-f977a0f7cacc None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:32.661050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149c20-0904-4474-92c2-f977a0f7cacc None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:32.661327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149c20-0904-4474-92c2-f977a0f7cacc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:32.671345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07149c20-0904-4474-92c2-f977a0f7cacc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-07149c20-0904-4474-92c2-f977a0f7cacc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:32.677334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:32.678444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:32.679276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 329/667] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:32.680011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149c20-0904-4474-92c2-f977a0f7cacc None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:32.693919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f509da-3979-45fa-99d9-eef4635c4950 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:32.728284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399d3c2-e064-4d22-b401-3c38057308cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:32.728910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399d3c2-e064-4d22-b401-3c38057308cb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:32.729189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399d3c2-e064-4d22-b401-3c38057308cb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:32.729460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399d3c2-e064-4d22-b401-3c38057308cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:32.739858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399d3c2-e064-4d22-b401-3c38057308cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:32.741360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399d3c2-e064-4d22-b401-3c38057308cb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-1399d3c2-e064-4d22-b401-3c38057308cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:32.756117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:32.757133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:32.758067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:32.758067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:32.758067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:32.758497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 339/668] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:32.759366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399d3c2-e064-4d22-b401-3c38057308cb None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:32.779566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149c20-0904-4474-92c2-f977a0f7cacc None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:32.813303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28986397-bed4-42e0-b0f8-f536049434b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:32.813932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28986397-bed4-42e0-b0f8-f536049434b1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:32.814213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28986397-bed4-42e0-b0f8-f536049434b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:32.814492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28986397-bed4-42e0-b0f8-f536049434b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:32.815201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28986397-bed4-42e0-b0f8-f536049434b1 None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=f436ac7cc2f04919bb0ec1ad9fca5622) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:32.815530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28986397-bed4-42e0-b0f8-f536049434b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:32.816936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28986397-bed4-42e0-b0f8-f536049434b1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:32.822433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 330/669] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:32 2022] GET /identity/v3/role_assignments?user.id=f436ac7cc2f04919bb0ec1ad9fca5622&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:32.823194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28986397-bed4-42e0-b0f8-f536049434b1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:32.862286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:32.863128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:32.866960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399d3c2-e064-4d22-b401-3c38057308cb None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:32.905183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6687b54-e9ea-4266-80a5-1c1acb63f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:32.905803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687b54-e9ea-4266-80a5-1c1acb63f986 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:32.906083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687b54-e9ea-4266-80a5-1c1acb63f986 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:32.906364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687b54-e9ea-4266-80a5-1c1acb63f986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:32.907099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6687b54-e9ea-4266-80a5-1c1acb63f986 None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=a3de64d734a04f9e9ab0d85e5c985e6a) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:32.907438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6687b54-e9ea-4266-80a5-1c1acb63f986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:32.909787 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6687b54-e9ea-4266-80a5-1c1acb63f986 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:32.916442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 340/670] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:32 2022] GET /identity/v3/role_assignments?user.id=a3de64d734a04f9e9ab0d85e5c985e6a&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:32.916442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6687b54-e9ea-4266-80a5-1c1acb63f986 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:32.956650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28986397-bed4-42e0-b0f8-f536049434b1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.010058 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7e29-3362-4512-856e-9c1e0b66cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.010869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7e29-3362-4512-856e-9c1e0b66cc40 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.011147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7e29-3362-4512-856e-9c1e0b66cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.011451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7e29-3362-4512-856e-9c1e0b66cc40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.032207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e7e29-3362-4512-856e-9c1e0b66cc40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.034340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e7e29-3362-4512-856e-9c1e0b66cc40 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-6d9e7e29-3362-4512-856e-9c1e0b66cc40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:33.064791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:33.065992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:33.067077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:33.067077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:33.067077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:33.068917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 331/671] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:33.069686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6687b54-e9ea-4266-80a5-1c1acb63f986 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.070203 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7e29-3362-4512-856e-9c1e0b66cc40 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:33.112482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d87ef7-ca9c-455c-b8af-b0eccefb1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.113048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d87ef7-ca9c-455c-b8af-b0eccefb1094 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.113327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d87ef7-ca9c-455c-b8af-b0eccefb1094 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.113602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d87ef7-ca9c-455c-b8af-b0eccefb1094 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.114268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d87ef7-ca9c-455c-b8af-b0eccefb1094 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:33.114571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d87ef7-ca9c-455c-b8af-b0eccefb1094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.115991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d87ef7-ca9c-455c-b8af-b0eccefb1094 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.127030 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 341/672] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:33.127935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d87ef7-ca9c-455c-b8af-b0eccefb1094 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:33.154005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:33.167629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:33.202882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7e29-3362-4512-856e-9c1e0b66cc40 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.251065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d87ef7-ca9c-455c-b8af-b0eccefb1094 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.255622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8aa23-d449-4e6f-a6b2-386c4e64ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.256237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8aa23-d449-4e6f-a6b2-386c4e64ecdd None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.256518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8aa23-d449-4e6f-a6b2-386c4e64ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.259480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8aa23-d449-4e6f-a6b2-386c4e64ecdd None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.260432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8aa23-d449-4e6f-a6b2-386c4e64ecdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:33.260964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8aa23-d449-4e6f-a6b2-386c4e64ecdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.263094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8aa23-d449-4e6f-a6b2-386c4e64ecdd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.281707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 332/673] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:33.283412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8aa23-d449-4e6f-a6b2-386c4e64ecdd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:33.294357 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03111e-c60c-4926-bec6-7ef60b006783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.295057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03111e-c60c-4926-bec6-7ef60b006783 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.295428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03111e-c60c-4926-bec6-7ef60b006783 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.295800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03111e-c60c-4926-bec6-7ef60b006783 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.296525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03111e-c60c-4926-bec6-7ef60b006783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:33.297195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03111e-c60c-4926-bec6-7ef60b006783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.298467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03111e-c60c-4926-bec6-7ef60b006783 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.312200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 342/674] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:33.318293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03111e-c60c-4926-bec6-7ef60b006783 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:33.407692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:33.417758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8aa23-d449-4e6f-a6b2-386c4e64ecdd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.425653 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03111e-c60c-4926-bec6-7ef60b006783 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.465218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8f52-35fd-478e-9d05-2797143fbb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.466226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8f52-35fd-478e-9d05-2797143fbb59 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.466727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8f52-35fd-478e-9d05-2797143fbb59 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.467193 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8f52-35fd-478e-9d05-2797143fbb59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.468219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf34b-7599-488e-9da5-a6a08daaeaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.468857 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf34b-7599-488e-9da5-a6a08daaeaea None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.469142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf34b-7599-488e-9da5-a6a08daaeaea None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.469419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf34b-7599-488e-9da5-a6a08daaeaea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.475875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:33.480338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8f52-35fd-478e-9d05-2797143fbb59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.482266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8f52-35fd-478e-9d05-2797143fbb59 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.482548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf34b-7599-488e-9da5-a6a08daaeaea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.484126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf34b-7599-488e-9da5-a6a08daaeaea None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-2bcbf34b-7599-488e-9da5-a6a08daaeaea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:33.497846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:33.498768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:33.499701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:33.499701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:33.499701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:33.499701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:33.499701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:33.499701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:33.499701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:33.499701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:33.499701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 343/675] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:33.500676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf34b-7599-488e-9da5-a6a08daaeaea None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-6e2e8f52-35fd-478e-9d05-2797143fbb59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:33.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:33.503252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:33.504162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:33.504162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:33.504162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:33.507517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 333/676] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:33.508674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8f52-35fd-478e-9d05-2797143fbb59 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:33.636168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf34b-7599-488e-9da5-a6a08daaeaea None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.637074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8f52-35fd-478e-9d05-2797143fbb59 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.673859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6db284-ae1c-4598-bd1f-a2cb0ebe572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.674790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6db284-ae1c-4598-bd1f-a2cb0ebe572c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.675245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6db284-ae1c-4598-bd1f-a2cb0ebe572c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.675731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6db284-ae1c-4598-bd1f-a2cb0ebe572c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.682897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414f969-f5a7-4dbf-94b2-ca34096d09d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.683560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414f969-f5a7-4dbf-94b2-ca34096d09d9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.683852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414f969-f5a7-4dbf-94b2-ca34096d09d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.684128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414f969-f5a7-4dbf-94b2-ca34096d09d9 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.684394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6db284-ae1c-4598-bd1f-a2cb0ebe572c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.684813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414f969-f5a7-4dbf-94b2-ca34096d09d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:33.685123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414f969-f5a7-4dbf-94b2-ca34096d09d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.686549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414f969-f5a7-4dbf-94b2-ca34096d09d9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.686748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6db284-ae1c-4598-bd1f-a2cb0ebe572c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-cd6db284-ae1c-4598-bd1f-a2cb0ebe572c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:33.699350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:33.700268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:33.701174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:33.701174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:33.701174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:33.701174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:33.701174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:33.701174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:33.701174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:33.701174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:33.701615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 334/677] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:33.701615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414f969-f5a7-4dbf-94b2-ca34096d09d9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:33.707399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 344/678] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:33.708603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6db284-ae1c-4598-bd1f-a2cb0ebe572c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:33.734115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:33.763097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:33.823331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414f969-f5a7-4dbf-94b2-ca34096d09d9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.844545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6db284-ae1c-4598-bd1f-a2cb0ebe572c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:33.860257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c9dc-c184-4533-b0d6-29581e22bb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.861393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c9dc-c184-4533-b0d6-29581e22bb14 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.861672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c9dc-c184-4533-b0d6-29581e22bb14 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.861942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c9dc-c184-4533-b0d6-29581e22bb14 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.862635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c9dc-c184-4533-b0d6-29581e22bb14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:33.863057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c9dc-c184-4533-b0d6-29581e22bb14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.864544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c9dc-c184-4533-b0d6-29581e22bb14 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.878084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 335/679] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:33.879049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c9dc-c184-4533-b0d6-29581e22bb14 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:33.889685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8434b37-2cc9-43e1-b958-0267b9ba60cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:33.891003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8434b37-2cc9-43e1-b958-0267b9ba60cc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:33.891466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8434b37-2cc9-43e1-b958-0267b9ba60cc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:33.891956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8434b37-2cc9-43e1-b958-0267b9ba60cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:33.893574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8434b37-2cc9-43e1-b958-0267b9ba60cc None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=a4403ef0835a4d658f8eb50fac0780eb) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:33.894039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8434b37-2cc9-43e1-b958-0267b9ba60cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:33.896477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8434b37-2cc9-43e1-b958-0267b9ba60cc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:33.907778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 345/680] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/role_assignments?user.id=a4403ef0835a4d658f8eb50fac0780eb&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:33.908902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8434b37-2cc9-43e1-b958-0267b9ba60cc None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:34.039153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c9dc-c184-4533-b0d6-29581e22bb14 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:34.054180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:34.087175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8277c2-aba9-488d-88c5-f6363f3e4269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:34.088618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8277c2-aba9-488d-88c5-f6363f3e4269 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:34.089059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8277c2-aba9-488d-88c5-f6363f3e4269 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:34.089489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8277c2-aba9-488d-88c5-f6363f3e4269 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:34.090326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8277c2-aba9-488d-88c5-f6363f3e4269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:34.090917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8277c2-aba9-488d-88c5-f6363f3e4269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:34.091908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:34.093358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8277c2-aba9-488d-88c5-f6363f3e4269 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:34.109773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 336/681] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:34.116280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8277c2-aba9-488d-88c5-f6363f3e4269 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:34.145949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8434b37-2cc9-43e1-b958-0267b9ba60cc None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:34.193978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12faab8-c559-4869-9d71-f969508625c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:34.194816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12faab8-c559-4869-9d71-f969508625c8 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:34.195194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12faab8-c559-4869-9d71-f969508625c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:34.195658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12faab8-c559-4869-9d71-f969508625c8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:34.203991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12faab8-c559-4869-9d71-f969508625c8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:34.206236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12faab8-c559-4869-9d71-f969508625c8 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-d12faab8-c559-4869-9d71-f969508625c8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:34.219164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:34.221020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:34.222124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:34.222723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 346/682] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:34.228602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12faab8-c559-4869-9d71-f969508625c8 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:34.252353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8277c2-aba9-488d-88c5-f6363f3e4269 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:34.293366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a75ab-6211-4fcf-a838-3cba22fc1f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:34.293994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a75ab-6211-4fcf-a838-3cba22fc1f5f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:34.294340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a75ab-6211-4fcf-a838-3cba22fc1f5f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:34.294684 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a75ab-6211-4fcf-a838-3cba22fc1f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:34.295787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a75ab-6211-4fcf-a838-3cba22fc1f5f None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=7d8054e88916456991bf485c19f8b502) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:34.295977 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a75ab-6211-4fcf-a838-3cba22fc1f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:34.297552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a75ab-6211-4fcf-a838-3cba22fc1f5f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:34.306261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 337/683] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:34 2022] GET /identity/v3/role_assignments?user.id=7d8054e88916456991bf485c19f8b502&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:34.351719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12faab8-c559-4869-9d71-f969508625c8 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:34.395049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:34.396051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737a4a2-d674-4729-b2ac-9ef4d1cacfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:34.396677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737a4a2-d674-4729-b2ac-9ef4d1cacfbd None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:34.396967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737a4a2-d674-4729-b2ac-9ef4d1cacfbd None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:34.397252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737a4a2-d674-4729-b2ac-9ef4d1cacfbd None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:34.398006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737a4a2-d674-4729-b2ac-9ef4d1cacfbd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:34.398313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737a4a2-d674-4729-b2ac-9ef4d1cacfbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:34.399936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737a4a2-d674-4729-b2ac-9ef4d1cacfbd None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:34.434951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 347/684] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 07:36:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:34.436348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a75ab-6211-4fcf-a838-3cba22fc1f5f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:34.487695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:34.565103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a75ab-6211-4fcf-a838-3cba22fc1f5f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:34.602032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92610e63-c949-4b67-9ed3-867d0504ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:34.602642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92610e63-c949-4b67-9ed3-867d0504ae15 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:34.602923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92610e63-c949-4b67-9ed3-867d0504ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:34.603196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92610e63-c949-4b67-9ed3-867d0504ae15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:34.678570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92610e63-c949-4b67-9ed3-867d0504ae15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:34.680134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92610e63-c949-4b67-9ed3-867d0504ae15 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:34.716789 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:34.791971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 338/685] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:34.797676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737a4a2-d674-4729-b2ac-9ef4d1cacfbd None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:34.914239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737a4a2-d674-4729-b2ac-9ef4d1cacfbd None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:34.951736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4436bb8-cd62-4125-a455-248f1e7ab9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:34.952368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436bb8-cd62-4125-a455-248f1e7ab9b6 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:34.952647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436bb8-cd62-4125-a455-248f1e7ab9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:34.952917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4436bb8-cd62-4125-a455-248f1e7ab9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:34.963792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436bb8-cd62-4125-a455-248f1e7ab9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:34.969099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4436bb8-cd62-4125-a455-248f1e7ab9b6 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-b4436bb8-cd62-4125-a455-248f1e7ab9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:34.981409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:34.982381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:34.983467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:34.983467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:34.983467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:34.983467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 348/686] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:34.992415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92610e63-c949-4b67-9ed3-867d0504ae15 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:35.020627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392ec59-dbea-4610-a1e0-1d0d1161995a None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.021002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392ec59-dbea-4610-a1e0-1d0d1161995a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.021167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392ec59-dbea-4610-a1e0-1d0d1161995a None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.022760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 349/687] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:35.027739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aa7ec-a298-4803-83c5-f7ebe3e81332 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.028025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aa7ec-a298-4803-83c5-f7ebe3e81332 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.028299 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aa7ec-a298-4803-83c5-f7ebe3e81332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.051174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-b81aa7ec-a298-4803-83c5-f7ebe3e81332 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:35.052662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b81aa7ec-a298-4803-83c5-f7ebe3e81332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:35.083940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:35.123713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 350/688] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:36:35.160907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92610e63-c949-4b67-9ed3-867d0504ae15 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:35.210936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a1310-c5ae-40f1-81a2-9b113444a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:35.211487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a1310-c5ae-40f1-81a2-9b113444a042 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.211768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a1310-c5ae-40f1-81a2-9b113444a042 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.212037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a1310-c5ae-40f1-81a2-9b113444a042 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.212677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a1310-c5ae-40f1-81a2-9b113444a042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:35.212983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a1310-c5ae-40f1-81a2-9b113444a042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:35.214338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a1310-c5ae-40f1-81a2-9b113444a042 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:35.215804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:35.221026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f45cd-3dd7-4604-b480-c0e133be55b5 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.221547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f45cd-3dd7-4604-b480-c0e133be55b5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.221652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f45cd-3dd7-4604-b480-c0e133be55b5 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.223224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 351/689] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:35.230502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed397b-669a-4020-b0bc-4c3611bb6206 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.230793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed397b-669a-4020-b0bc-4c3611bb6206 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.231069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed397b-669a-4020-b0bc-4c3611bb6206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.232705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 339/690] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:35.239586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a1310-c5ae-40f1-81a2-9b113444a042 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:35.261933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e8ed397b-669a-4020-b0bc-4c3611bb6206 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:35.263148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e8ed397b-669a-4020-b0bc-4c3611bb6206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:35.375112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 352/691] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:35.423664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a1310-c5ae-40f1-81a2-9b113444a042 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:35.439591 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed397b-669a-4020-b0bc-4c3611bb6206 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:35.476105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacc78a-febf-46e3-999a-b90e180f2d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:35.477096 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacc78a-febf-46e3-999a-b90e180f2d5c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.477578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacc78a-febf-46e3-999a-b90e180f2d5c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.478048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacc78a-febf-46e3-999a-b90e180f2d5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.492320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacc78a-febf-46e3-999a-b90e180f2d5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:35.494126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacc78a-febf-46e3-999a-b90e180f2d5c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-5aacc78a-febf-46e3-999a-b90e180f2d5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:35.517212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:35.518146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:35.519446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:35.519446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:35.519446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:35.519446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:35.519446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:35.519446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:35.519446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:35.519446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:35.519446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 340/692] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:35.525787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacc78a-febf-46e3-999a-b90e180f2d5c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:35.543473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:35.547410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed397b-669a-4020-b0bc-4c3611bb6206 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:35.584419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962468f0-707f-4d2b-b253-56283cdabc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:35.585056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962468f0-707f-4d2b-b253-56283cdabc5f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.585337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962468f0-707f-4d2b-b253-56283cdabc5f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.585606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962468f0-707f-4d2b-b253-56283cdabc5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.596935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962468f0-707f-4d2b-b253-56283cdabc5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:35.598385 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962468f0-707f-4d2b-b253-56283cdabc5f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-962468f0-707f-4d2b-b253-56283cdabc5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:35.614954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:35.615969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:35.617673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:35.617673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:35.617673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:35.617673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 353/693] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:35.622180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962468f0-707f-4d2b-b253-56283cdabc5f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:35.663636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:35.727688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962468f0-707f-4d2b-b253-56283cdabc5f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:35.766670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacc78a-febf-46e3-999a-b90e180f2d5c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:35.767440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960fd8-5629-44e7-84c0-f3b6de273895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:35.768062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960fd8-5629-44e7-84c0-f3b6de273895 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.768611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960fd8-5629-44e7-84c0-f3b6de273895 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.768892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960fd8-5629-44e7-84c0-f3b6de273895 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.770445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960fd8-5629-44e7-84c0-f3b6de273895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:35.770759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960fd8-5629-44e7-84c0-f3b6de273895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:35.772186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960fd8-5629-44e7-84c0-f3b6de273895 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:35.789961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 354/694] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:35.790947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960fd8-5629-44e7-84c0-f3b6de273895 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:35.808061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:35.815399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b43aa-41a5-4a31-863e-25e3c7b419a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:35.816317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b43aa-41a5-4a31-863e-25e3c7b419a1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.816603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b43aa-41a5-4a31-863e-25e3c7b419a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.816881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b43aa-41a5-4a31-863e-25e3c7b419a1 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.817579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b43aa-41a5-4a31-863e-25e3c7b419a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:35.817892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b43aa-41a5-4a31-863e-25e3c7b419a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:35.820180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b43aa-41a5-4a31-863e-25e3c7b419a1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:35.837419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 341/695] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:35.838291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b43aa-41a5-4a31-863e-25e3c7b419a1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:35.931623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960fd8-5629-44e7-84c0-f3b6de273895 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:35.946059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b43aa-41a5-4a31-863e-25e3c7b419a1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:35.963593 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:35.971594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bfab2-84b4-4c65-985f-edc7a3935b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:35.972233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bfab2-84b4-4c65-985f-edc7a3935b6c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.972510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bfab2-84b4-4c65-985f-edc7a3935b6c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.972780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bfab2-84b4-4c65-985f-edc7a3935b6c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.973361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bfab2-84b4-4c65-985f-edc7a3935b6c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:35.974924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bfab2-84b4-4c65-985f-edc7a3935b6c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:35.986363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924f4a4-21e2-4e05-9d9b-ce2355697957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-d78bfab2-84b4-4c65-985f-edc7a3935b6c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:35.987264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:35.988296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:36:35.989136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:35.990365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924f4a4-21e2-4e05-9d9b-ce2355697957 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:35.990827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924f4a4-21e2-4e05-9d9b-ce2355697957 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:35.991306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924f4a4-21e2-4e05-9d9b-ce2355697957 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:35.999516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924f4a4-21e2-4e05-9d9b-ce2355697957 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:35.999516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924f4a4-21e2-4e05-9d9b-ce2355697957 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:35.999703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 355/696] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 24 07:36:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:35.999703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bfab2-84b4-4c65-985f-edc7a3935b6c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:36.079968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 342/697] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:36:35 2022] POST /identity/v3/users => generated 254 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:36.079968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924f4a4-21e2-4e05-9d9b-ce2355697957 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:36.092205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:36.151307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bfab2-84b4-4c65-985f-edc7a3935b6c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:36.233654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4d577-cc7a-4497-8794-45976f799c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:36.233654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4d577-cc7a-4497-8794-45976f799c0e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:36.233964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4d577-cc7a-4497-8794-45976f799c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:36.234206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4d577-cc7a-4497-8794-45976f799c0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:36.234810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4d577-cc7a-4497-8794-45976f799c0e None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=15d9847a3a5048efb19e507f988e37f4) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:36.238716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4d577-cc7a-4497-8794-45976f799c0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:36.240198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4d577-cc7a-4497-8794-45976f799c0e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:36.248604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 356/698] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:35 2022] GET /identity/v3/role_assignments?user.id=15d9847a3a5048efb19e507f988e37f4&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:36.276746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924f4a4-21e2-4e05-9d9b-ce2355697957 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:36.317509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce23c0b-db75-4bad-8d63-40325e676d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:36.318139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce23c0b-db75-4bad-8d63-40325e676d99 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:36.318413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce23c0b-db75-4bad-8d63-40325e676d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:36.318682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce23c0b-db75-4bad-8d63-40325e676d99 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:36.319430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce23c0b-db75-4bad-8d63-40325e676d99 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:36.319732 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce23c0b-db75-4bad-8d63-40325e676d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:36.321123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce23c0b-db75-4bad-8d63-40325e676d99 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:36.326649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 343/699] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 07:36:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:36.333328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4d577-cc7a-4497-8794-45976f799c0e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:36.465267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4d577-cc7a-4497-8794-45976f799c0e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:36.510800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d22e6-3bc1-432f-b93e-e673ceeff8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:36.511381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d22e6-3bc1-432f-b93e-e673ceeff8fc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:36.511666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d22e6-3bc1-432f-b93e-e673ceeff8fc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:36.511999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d22e6-3bc1-432f-b93e-e673ceeff8fc None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:36.512624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d22e6-3bc1-432f-b93e-e673ceeff8fc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:36.512963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d22e6-3bc1-432f-b93e-e673ceeff8fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:36.514435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d22e6-3bc1-432f-b93e-e673ceeff8fc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:36.521864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 357/700] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 07:36:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:36.531705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd1874-27ac-4a10-b457-7b901d63109b None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:36.532032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd1874-27ac-4a10-b457-7b901d63109b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:36.532879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd1874-27ac-4a10-b457-7b901d63109b None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:36.535025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 344/701] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:36.541107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610502f7-85f5-4316-8230-54b7f9d277b1 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:36.546831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610502f7-85f5-4316-8230-54b7f9d277b1 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:36.546831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610502f7-85f5-4316-8230-54b7f9d277b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:36.549593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:36.566114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-610502f7-85f5-4316-8230-54b7f9d277b1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:36.567434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-610502f7-85f5-4316-8230-54b7f9d277b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:36.655480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 358/702] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:36.920865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277236-1202-4e20-9ca1-e6aa4ef3a0e1 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:36.921352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277236-1202-4e20-9ca1-e6aa4ef3a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:36.921352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97277236-1202-4e20-9ca1-e6aa4ef3a0e1 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:36.922848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 345/703] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:36.937005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e218c0-02e4-4a1a-a0e4-255c10b0a651 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:36.937524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e218c0-02e4-4a1a-a0e4-255c10b0a651 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:36.937603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e218c0-02e4-4a1a-a0e4-255c10b0a651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:36.948705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97277236-1202-4e20-9ca1-e6aa4ef3a0e1 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:36.962029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a4e218c0-02e4-4a1a-a0e4-255c10b0a651 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:36.965307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a4e218c0-02e4-4a1a-a0e4-255c10b0a651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:36.998318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:37.068928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 359/704] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:37.129006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97277236-1202-4e20-9ca1-e6aa4ef3a0e1 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:37.183549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ae432-5b10-4bea-8e77-cb599546b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:37.184112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ae432-5b10-4bea-8e77-cb599546b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:37.184395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ae432-5b10-4bea-8e77-cb599546b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:37.184671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ae432-5b10-4bea-8e77-cb599546b5f6 None admin] PATH_INFO: `/v3/services/network` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:37.185262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ae432-5b10-4bea-8e77-cb599546b5f6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:37.186627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ae432-5b10-4bea-8e77-cb599546b5f6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-168ae432-5b10-4bea-8e77-cb599546b5f6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:37.198399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:37.199505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:36:37.200375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:37.204771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 346/705] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:36 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:37.210352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e218c0-02e4-4a1a-a0e4-255c10b0a651 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:37.308583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:37.359192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e218c0-02e4-4a1a-a0e4-255c10b0a651 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:37.394050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ae432-5b10-4bea-8e77-cb599546b5f6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:37.413094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0f5da-ae2e-4261-98f8-8ccbc0279d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:37.413716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0f5da-ae2e-4261-98f8-8ccbc0279d1f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:37.414002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0f5da-ae2e-4261-98f8-8ccbc0279d1f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:37.414283 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0f5da-ae2e-4261-98f8-8ccbc0279d1f None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:37.414927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0f5da-ae2e-4261-98f8-8ccbc0279d1f None admin] RBAC: Adding query filter params (name=network) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:37.415227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0f5da-ae2e-4261-98f8-8ccbc0279d1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:37.417864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0f5da-ae2e-4261-98f8-8ccbc0279d1f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:37.427575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 360/706] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:36:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:37.433629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0f5da-ae2e-4261-98f8-8ccbc0279d1f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:37.565355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0f5da-ae2e-4261-98f8-8ccbc0279d1f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:37.591675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:37.598248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ae432-5b10-4bea-8e77-cb599546b5f6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:37.618954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:37.632344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78749d-4684-48fc-990e-4d4ea80c2f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:37.633266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78749d-4684-48fc-990e-4d4ea80c2f41 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:37.633860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78749d-4684-48fc-990e-4d4ea80c2f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:37.634346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78749d-4684-48fc-990e-4d4ea80c2f41 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:37.635168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78749d-4684-48fc-990e-4d4ea80c2f41 None admin] RBAC: Adding query filter params (type=network) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:37.635701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78749d-4684-48fc-990e-4d4ea80c2f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:37.637293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78749d-4684-48fc-990e-4d4ea80c2f41 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:37.645495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 361/707] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:36:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:37.654007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39610bd-20fb-4145-8086-35b9877ce583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:37.655047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39610bd-20fb-4145-8086-35b9877ce583 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:37.655578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39610bd-20fb-4145-8086-35b9877ce583 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:37.656079 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39610bd-20fb-4145-8086-35b9877ce583 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:37.669465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39610bd-20fb-4145-8086-35b9877ce583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-e39610bd-20fb-4145-8086-35b9877ce583 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:37.675279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:37.676572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:37.677428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:37.680084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 347/708] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:37.686462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78749d-4684-48fc-990e-4d4ea80c2f41 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:37.825842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78749d-4684-48fc-990e-4d4ea80c2f41 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:37.873591 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2507b-d26a-4dbd-bad4-6f6ff1f44edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:37.874575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2507b-d26a-4dbd-bad4-6f6ff1f44edd None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:37.875068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2507b-d26a-4dbd-bad4-6f6ff1f44edd None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:37.875561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2507b-d26a-4dbd-bad4-6f6ff1f44edd None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:37.877241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2507b-d26a-4dbd-bad4-6f6ff1f44edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:37.877766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2507b-d26a-4dbd-bad4-6f6ff1f44edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:37.879364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2507b-d26a-4dbd-bad4-6f6ff1f44edd None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:37.889281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 362/709] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:37.895242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39610bd-20fb-4145-8086-35b9877ce583 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:38.052808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39610bd-20fb-4145-8086-35b9877ce583 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:38.100331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1dce1-ba07-4744-a12e-19913a09c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:38.101362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1dce1-ba07-4744-a12e-19913a09c97d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:38.101861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1dce1-ba07-4744-a12e-19913a09c97d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:38.102328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1dce1-ba07-4744-a12e-19913a09c97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:38.118885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1dce1-ba07-4744-a12e-19913a09c97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:38.120645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1dce1-ba07-4744-a12e-19913a09c97d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-4ec1dce1-ba07-4744-a12e-19913a09c97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:38.139378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:38.140346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:38.141237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:38.141237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:38.141237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:38.143954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 348/710] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:38.149913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2507b-d26a-4dbd-bad4-6f6ff1f44edd None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:38.221860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:38.280983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2507b-d26a-4dbd-bad4-6f6ff1f44edd None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:38.324263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b2166-1401-44bd-8b96-c9bc4437e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:38.325190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b2166-1401-44bd-8b96-c9bc4437e97c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:38.325683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b2166-1401-44bd-8b96-c9bc4437e97c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:38.326169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b2166-1401-44bd-8b96-c9bc4437e97c None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:38.327009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b2166-1401-44bd-8b96-c9bc4437e97c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:38.327557 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b2166-1401-44bd-8b96-c9bc4437e97c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:38.329631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b2166-1401-44bd-8b96-c9bc4437e97c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:38.347221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 363/711] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:38.353145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1dce1-ba07-4744-a12e-19913a09c97d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:38.377590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:38.486182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1dce1-ba07-4744-a12e-19913a09c97d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:38.536646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acbc6c-b7d1-4e07-abec-8603404bbaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:38.537284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acbc6c-b7d1-4e07-abec-8603404bbaa2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:38.537562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acbc6c-b7d1-4e07-abec-8603404bbaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:38.537832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acbc6c-b7d1-4e07-abec-8603404bbaa2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:38.546057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d56772-dc1a-4050-ba69-b347c7fa01af None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:38.546341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d56772-dc1a-4050-ba69-b347c7fa01af None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:38.546620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d56772-dc1a-4050-ba69-b347c7fa01af None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:38.548322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 364/712] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:38.553497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126a0dd-99da-4252-8853-35068b3a033f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:38.553779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126a0dd-99da-4252-8853-35068b3a033f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:38.554054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126a0dd-99da-4252-8853-35068b3a033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:38.565255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acbc6c-b7d1-4e07-abec-8603404bbaa2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:38.566718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acbc6c-b7d1-4e07-abec-8603404bbaa2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:38.581994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e126a0dd-99da-4252-8853-35068b3a033f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:38.583121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e126a0dd-99da-4252-8853-35068b3a033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-f7acbc6c-b7d1-4e07-abec-8603404bbaa2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:38.590476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:38.591429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:38.592362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:38.592895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 349/713] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 07:36:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:38.601909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acbc6c-b7d1-4e07-abec-8603404bbaa2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:38.713915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 365/714] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:38.743681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:38.752998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acbc6c-b7d1-4e07-abec-8603404bbaa2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:38.811501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d4c8f-470a-491c-ab92-8ce51a4981d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:38.812117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d4c8f-470a-491c-ab92-8ce51a4981d1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:38.812395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d4c8f-470a-491c-ab92-8ce51a4981d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:38.812666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d4c8f-470a-491c-ab92-8ce51a4981d1 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:38.813425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d4c8f-470a-491c-ab92-8ce51a4981d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:38.813730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d4c8f-470a-491c-ab92-8ce51a4981d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:38.815157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d4c8f-470a-491c-ab92-8ce51a4981d1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:38.839436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 350/715] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 07:36:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:38.845514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126a0dd-99da-4252-8853-35068b3a033f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:38.904364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:38.971346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130be3f1-0ac1-403e-9c52-207b09364ce6 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:38.971694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130be3f1-0ac1-403e-9c52-207b09364ce6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:38.971960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130be3f1-0ac1-403e-9c52-207b09364ce6 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:38.973412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 351/716] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:36:38.978677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7145b-c197-4a8b-9905-8049dbf17408 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:38.982816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7145b-c197-4a8b-9905-8049dbf17408 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:38.982816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7145b-c197-4a8b-9905-8049dbf17408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:38.983114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126a0dd-99da-4252-8853-35068b3a033f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:39.027584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-4cd7145b-c197-4a8b-9905-8049dbf17408 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:39.030010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4cd7145b-c197-4a8b-9905-8049dbf17408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:39.069252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22273d83-994e-4949-a032-5a0bb2ec21cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:39.072228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273d83-994e-4949-a032-5a0bb2ec21cd None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:39.072692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273d83-994e-4949-a032-5a0bb2ec21cd None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:39.073112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273d83-994e-4949-a032-5a0bb2ec21cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:39.148330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 352/717] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:39.149829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7145b-c197-4a8b-9905-8049dbf17408 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:39.173108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22273d83-994e-4949-a032-5a0bb2ec21cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:39.174634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22273d83-994e-4949-a032-5a0bb2ec21cd None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:39.221549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:39.231247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:39.264002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7145b-c197-4a8b-9905-8049dbf17408 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:39.301004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a056f-92e8-4daa-816f-8d5190e518f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:39.302099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a056f-92e8-4daa-816f-8d5190e518f7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:39.302440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a056f-92e8-4daa-816f-8d5190e518f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:39.302780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a056f-92e8-4daa-816f-8d5190e518f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:39.305705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 366/718] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:39.307336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a99dd-0f5c-4a56-9ac5-fb667b1e8a55 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:39.307975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a99dd-0f5c-4a56-9ac5-fb667b1e8a55 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:39.308557 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a99dd-0f5c-4a56-9ac5-fb667b1e8a55 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:39.310611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 367/719] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:39.311595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a99dd-0f5c-4a56-9ac5-fb667b1e8a55 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:39.319946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a056f-92e8-4daa-816f-8d5190e518f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-0b3a056f-92e8-4daa-816f-8d5190e518f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:39.326614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:39.327552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:39.328393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 353/720] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:39.329990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e3c0b-bd17-4965-b8b9-671a78fe58c6 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:39.330484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e3c0b-bd17-4965-b8b9-671a78fe58c6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:39.330838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e3c0b-bd17-4965-b8b9-671a78fe58c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:39.355691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-717e3c0b-bd17-4965-b8b9-671a78fe58c6 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:39.357108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-717e3c0b-bd17-4965-b8b9-671a78fe58c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:39.439195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a99dd-0f5c-4a56-9ac5-fb667b1e8a55 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:39.443422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 354/721] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:39.443422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e3c0b-bd17-4965-b8b9-671a78fe58c6 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:39.498822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f8e34-86ea-4a9a-a217-c64bf73d7f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:39.499228 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:39.500526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f8e34-86ea-4a9a-a217-c64bf73d7f6f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:39.501732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f8e34-86ea-4a9a-a217-c64bf73d7f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:39.501732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f8e34-86ea-4a9a-a217-c64bf73d7f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:39.511798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f8e34-86ea-4a9a-a217-c64bf73d7f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:39.513337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f8e34-86ea-4a9a-a217-c64bf73d7f6f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:39.515340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-570f8e34-86ea-4a9a-a217-c64bf73d7f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:39.529170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:39.530298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:39.531415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:39.531415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:39.531415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:39.531415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 368/722] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:39.531415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f8e34-86ea-4a9a-a217-c64bf73d7f6f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:39.559501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e3c0b-bd17-4965-b8b9-671a78fe58c6 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:39.598302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef3677-2523-4fad-bf28-1aecd107f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:39.599265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef3677-2523-4fad-bf28-1aecd107f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:39.599809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef3677-2523-4fad-bf28-1aecd107f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:39.600224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef3677-2523-4fad-bf28-1aecd107f1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:39.601030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef3677-2523-4fad-bf28-1aecd107f1e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:39.601501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef3677-2523-4fad-bf28-1aecd107f1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:39.603219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef3677-2523-4fad-bf28-1aecd107f1e4 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:39.612636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 355/723] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:39.613827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef3677-2523-4fad-bf28-1aecd107f1e4 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:39.645294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f8e34-86ea-4a9a-a217-c64bf73d7f6f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:39.682824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0526d0-a11b-4a08-9831-87861716ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:39.683481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0526d0-a11b-4a08-9831-87861716ce0f None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:39.683774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0526d0-a11b-4a08-9831-87861716ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:39.684049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0526d0-a11b-4a08-9831-87861716ce0f None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:39.684694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0526d0-a11b-4a08-9831-87861716ce0f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:39.686228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0526d0-a11b-4a08-9831-87861716ce0f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:39.723006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef3677-2523-4fad-bf28-1aecd107f1e4 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:39.734968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:39.761919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5babec-e90e-4628-9a4f-d6a370d29b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:39.762515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5babec-e90e-4628-9a4f-d6a370d29b6f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:39.763056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5babec-e90e-4628-9a4f-d6a370d29b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:39.763351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5babec-e90e-4628-9a4f-d6a370d29b6f None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:39.764016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5babec-e90e-4628-9a4f-d6a370d29b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:39.764313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5babec-e90e-4628-9a4f-d6a370d29b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:39.765674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5babec-e90e-4628-9a4f-d6a370d29b6f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:39.778093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 356/724] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:39.778986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5babec-e90e-4628-9a4f-d6a370d29b6f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:39.796834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 369/725] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:36:39 2022] POST /identity/v3/services => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:39.796834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0526d0-a11b-4a08-9831-87861716ce0f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:39.882616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:39.894082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5babec-e90e-4628-9a4f-d6a370d29b6f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:39.953555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088e2b7-3b21-46d9-8ae0-221af62d6d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:39.954369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0526d0-a11b-4a08-9831-87861716ce0f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:39.954479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088e2b7-3b21-46d9-8ae0-221af62d6d23 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:39.954562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088e2b7-3b21-46d9-8ae0-221af62d6d23 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:39.954920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088e2b7-3b21-46d9-8ae0-221af62d6d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:39.968081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088e2b7-3b21-46d9-8ae0-221af62d6d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:39.970716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088e2b7-3b21-46d9-8ae0-221af62d6d23 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-4088e2b7-3b21-46d9-8ae0-221af62d6d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:39.986177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:39.987160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:39.988106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:39.988106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:39.988106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:39.988106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 357/726] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:39.988338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088e2b7-3b21-46d9-8ae0-221af62d6d23 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.016506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:40.038900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a9e9b-5737-475d-947a-b1d98738a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.039625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a9e9b-5737-475d-947a-b1d98738a5d1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.039917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a9e9b-5737-475d-947a-b1d98738a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.040204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a9e9b-5737-475d-947a-b1d98738a5d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.057703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a9e9b-5737-475d-947a-b1d98738a5d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-0c0a9e9b-5737-475d-947a-b1d98738a5d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:40.063362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:40.064393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:40.065441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:40.069653 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 370/727] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:40.070543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a9e9b-5737-475d-947a-b1d98738a5d1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.116967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088e2b7-3b21-46d9-8ae0-221af62d6d23 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:40.153211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeac6f-ce91-4977-91c0-c1a00aeab0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.153891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeac6f-ce91-4977-91c0-c1a00aeab0a4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.154362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeac6f-ce91-4977-91c0-c1a00aeab0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.154362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeac6f-ce91-4977-91c0-c1a00aeab0a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.161916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeac6f-ce91-4977-91c0-c1a00aeab0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:40.163228 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeac6f-ce91-4977-91c0-c1a00aeab0a4 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-adfeac6f-ce91-4977-91c0-c1a00aeab0a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:40.175535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:40.176717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 358/728] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:40.177660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeac6f-ce91-4977-91c0-c1a00aeab0a4 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.184550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a9e9b-5737-475d-947a-b1d98738a5d1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:40.196906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:40.222096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a6918-4e23-49b0-aa87-6cc49d48654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.223149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a6918-4e23-49b0-aa87-6cc49d48654d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.223459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a6918-4e23-49b0-aa87-6cc49d48654d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.223736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a6918-4e23-49b0-aa87-6cc49d48654d None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.224722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a6918-4e23-49b0-aa87-6cc49d48654d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:40.225026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a6918-4e23-49b0-aa87-6cc49d48654d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:40.226418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a6918-4e23-49b0-aa87-6cc49d48654d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:40.239262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 371/729] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:40.240519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26de4d-f305-4b51-9e83-55e176159081 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.240813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26de4d-f305-4b51-9e83-55e176159081 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.241083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26de4d-f305-4b51-9e83-55e176159081 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.246446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 372/730] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:40.246446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26de4d-f305-4b51-9e83-55e176159081 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.272323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:40.295540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeac6f-ce91-4977-91c0-c1a00aeab0a4 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:40.333122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268e738-64ff-45ce-a3c3-3979fb00a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.333727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e738-64ff-45ce-a3c3-3979fb00a65c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.334003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e738-64ff-45ce-a3c3-3979fb00a65c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.334315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e738-64ff-45ce-a3c3-3979fb00a65c None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.334924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268e738-64ff-45ce-a3c3-3979fb00a65c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:40.338043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268e738-64ff-45ce-a3c3-3979fb00a65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:40.338043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268e738-64ff-45ce-a3c3-3979fb00a65c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:40.346618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 359/731] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:40.352050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268e738-64ff-45ce-a3c3-3979fb00a65c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.360853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26de4d-f305-4b51-9e83-55e176159081 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:40.397277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088da6b-270a-478c-b08a-18af22d2391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.398007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088da6b-270a-478c-b08a-18af22d2391e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.398300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088da6b-270a-478c-b08a-18af22d2391e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.398584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088da6b-270a-478c-b08a-18af22d2391e None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.399273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088da6b-270a-478c-b08a-18af22d2391e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:40.399612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088da6b-270a-478c-b08a-18af22d2391e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:40.401058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088da6b-270a-478c-b08a-18af22d2391e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:40.417795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 373/732] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:40.419040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314b0b4-f44a-40fc-b465-2bb0336689b1 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.419347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314b0b4-f44a-40fc-b465-2bb0336689b1 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.419635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314b0b4-f44a-40fc-b465-2bb0336689b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.439462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6314b0b4-f44a-40fc-b465-2bb0336689b1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:40.440668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6314b0b4-f44a-40fc-b465-2bb0336689b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:40.460809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268e738-64ff-45ce-a3c3-3979fb00a65c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:40.464792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:40.496448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444775a8-d741-4696-b28d-bead9a44343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.496992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444775a8-d741-4696-b28d-bead9a44343e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.497284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444775a8-d741-4696-b28d-bead9a44343e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.497542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444775a8-d741-4696-b28d-bead9a44343e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.505356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444775a8-d741-4696-b28d-bead9a44343e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:40.506780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444775a8-d741-4696-b28d-bead9a44343e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:40.509377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:40.519359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 374/733] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:36:40.519359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314b0b4-f44a-40fc-b465-2bb0336689b1 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-444775a8-d741-4696-b28d-bead9a44343e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:40.529737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:40.530668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:36:40.531713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:40.534848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 360/734] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:36:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:40.535969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444775a8-d741-4696-b28d-bead9a44343e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.649154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314b0b4-f44a-40fc-b465-2bb0336689b1 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:40.672843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444775a8-d741-4696-b28d-bead9a44343e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:40.698546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545b280-1cd5-4492-ae01-7a65173b6aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.699483 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b280-1cd5-4492-ae01-7a65173b6aee None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.699769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b280-1cd5-4492-ae01-7a65173b6aee None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.700050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b280-1cd5-4492-ae01-7a65173b6aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.709991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15126676-9af4-46f5-a228-add2e257adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.710718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15126676-9af4-46f5-a228-add2e257adbb None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.711100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15126676-9af4-46f5-a228-add2e257adbb None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.711515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15126676-9af4-46f5-a228-add2e257adbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.712388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15126676-9af4-46f5-a228-add2e257adbb None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=7d8054e88916456991bf485c19f8b502) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:40.712805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15126676-9af4-46f5-a228-add2e257adbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:40.713797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545b280-1cd5-4492-ae01-7a65173b6aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:40.714453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15126676-9af4-46f5-a228-add2e257adbb None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:40.715240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545b280-1cd5-4492-ae01-7a65173b6aee None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:40.727840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 361/735] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:40 2022] GET /identity/v3/role_assignments?user.id=7d8054e88916456991bf485c19f8b502&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:40.728941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15126676-9af4-46f5-a228-add2e257adbb None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-f545b280-1cd5-4492-ae01-7a65173b6aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:40.731943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:40.732894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:40.734801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:40.734801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:40.734801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:40.734801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 375/736] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:40.741779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545b280-1cd5-4492-ae01-7a65173b6aee None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.785404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:40.830232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:40.884122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15126676-9af4-46f5-a228-add2e257adbb None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:40.911758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545b280-1cd5-4492-ae01-7a65173b6aee None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:40.933163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1661fb9-d77f-495d-8c7c-a75e4cd6f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.933783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1661fb9-d77f-495d-8c7c-a75e4cd6f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.934068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1661fb9-d77f-495d-8c7c-a75e4cd6f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.934378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1661fb9-d77f-495d-8c7c-a75e4cd6f2f8 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.935672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1661fb9-d77f-495d-8c7c-a75e4cd6f2f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:40.936127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1661fb9-d77f-495d-8c7c-a75e4cd6f2f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:40.938523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1661fb9-d77f-495d-8c7c-a75e4cd6f2f8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:40.952616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc7737-bd47-41ac-9710-e0f7d560a5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:40.953423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc7737-bd47-41ac-9710-e0f7d560a5a1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:40.953941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc7737-bd47-41ac-9710-e0f7d560a5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:40.954318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc7737-bd47-41ac-9710-e0f7d560a5a1 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:40.955111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc7737-bd47-41ac-9710-e0f7d560a5a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:40.955569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc7737-bd47-41ac-9710-e0f7d560a5a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:40.957598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc7737-bd47-41ac-9710-e0f7d560a5a1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:40.963134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 362/737] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 07:36:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:40.968112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1661fb9-d77f-495d-8c7c-a75e4cd6f2f8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:40.975129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 376/738] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:40.976171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc7737-bd47-41ac-9710-e0f7d560a5a1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:41.054099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:41.098218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc7737-bd47-41ac-9710-e0f7d560a5a1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:41.099189 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1661fb9-d77f-495d-8c7c-a75e4cd6f2f8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:41.123574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:41.139623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba104-5563-455d-b91b-0f731f5d0bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:41.140543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba104-5563-455d-b91b-0f731f5d0bca None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:41.140850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846e8d-2ee8-4bcd-8f04-6d48330298bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:41.141445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba104-5563-455d-b91b-0f731f5d0bca None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:41.141621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846e8d-2ee8-4bcd-8f04-6d48330298bd None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:41.141921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846e8d-2ee8-4bcd-8f04-6d48330298bd None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:41.142254 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01846e8d-2ee8-4bcd-8f04-6d48330298bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:41.142504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba104-5563-455d-b91b-0f731f5d0bca None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:41.143389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba104-5563-455d-b91b-0f731f5d0bca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:41.145221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba104-5563-455d-b91b-0f731f5d0bca None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:41.216900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846e8d-2ee8-4bcd-8f04-6d48330298bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:41.218369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01846e8d-2ee8-4bcd-8f04-6d48330298bd None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:41.237706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 363/739] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:36:40 2022] POST /identity/v3/services => generated 240 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:41.237706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba104-5563-455d-b91b-0f731f5d0bca None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:41.383713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:41.424536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 377/740] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:40 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:36:41.434024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846e8d-2ee8-4bcd-8f04-6d48330298bd None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:41.472183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba104-5563-455d-b91b-0f731f5d0bca None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:41.512828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951d00-fe34-4333-ace3-37e4a16ca395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:41.513642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951d00-fe34-4333-ace3-37e4a16ca395 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:41.513993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951d00-fe34-4333-ace3-37e4a16ca395 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:41.514359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951d00-fe34-4333-ace3-37e4a16ca395 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:41.522908 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b951d00-fe34-4333-ace3-37e4a16ca395 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:41.524501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b951d00-fe34-4333-ace3-37e4a16ca395 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-0b951d00-fe34-4333-ace3-37e4a16ca395 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:41.536968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:41.538129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:41.539302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:41.540893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 364/741] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:41.546287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951d00-fe34-4333-ace3-37e4a16ca395 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:41.567999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01846e8d-2ee8-4bcd-8f04-6d48330298bd None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:41.605383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb64d-865c-4108-9dec-af2f4822e018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:41.606254 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb64d-865c-4108-9dec-af2f4822e018 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:41.606672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb64d-865c-4108-9dec-af2f4822e018 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:41.607081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb64d-865c-4108-9dec-af2f4822e018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:41.618533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edb64d-865c-4108-9dec-af2f4822e018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:41.620214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edb64d-865c-4108-9dec-af2f4822e018 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-89edb64d-865c-4108-9dec-af2f4822e018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:41.637388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:41.638566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:41.639670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:41.639670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:41.639670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:41.643104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:41.644491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 378/742] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:41.650022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb64d-865c-4108-9dec-af2f4822e018 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:41.678472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:41.758775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb64d-865c-4108-9dec-af2f4822e018 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:41.795778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b8d9f-2d9e-407c-9aac-830f44d13975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:41.796710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8d9f-2d9e-407c-9aac-830f44d13975 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:41.797165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8d9f-2d9e-407c-9aac-830f44d13975 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:41.797694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8d9f-2d9e-407c-9aac-830f44d13975 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:41.798584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b8d9f-2d9e-407c-9aac-830f44d13975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:41.799149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b8d9f-2d9e-407c-9aac-830f44d13975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:41.800670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b8d9f-2d9e-407c-9aac-830f44d13975 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:41.808532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951d00-fe34-4333-ace3-37e4a16ca395 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:41.824442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 379/743] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:41.830765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b8d9f-2d9e-407c-9aac-830f44d13975 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:41.882574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b36c-23a1-424e-811a-dc8fd97f6179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:41.883455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b36c-23a1-424e-811a-dc8fd97f6179 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:41.883872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b36c-23a1-424e-811a-dc8fd97f6179 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:41.884280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b36c-23a1-424e-811a-dc8fd97f6179 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:41.885147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b36c-23a1-424e-811a-dc8fd97f6179 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:41.885606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b36c-23a1-424e-811a-dc8fd97f6179 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:41.887173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b36c-23a1-424e-811a-dc8fd97f6179 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:41.911308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 365/744] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 07:36:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:41.917150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89c522-e7fe-42f2-9a97-504239236c30 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:41.917442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89c522-e7fe-42f2-9a97-504239236c30 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:41.917716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89c522-e7fe-42f2-9a97-504239236c30 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:41.919179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 366/745] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:41.924490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89c522-e7fe-42f2-9a97-504239236c30 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:41.949419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:41.968625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b8d9f-2d9e-407c-9aac-830f44d13975 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:42.019603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb919a3-3b67-4e7f-b82f-174cbb69438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:42.020777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb919a3-3b67-4e7f-b82f-174cbb69438b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.021204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb919a3-3b67-4e7f-b82f-174cbb69438b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.021918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb919a3-3b67-4e7f-b82f-174cbb69438b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.030958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb919a3-3b67-4e7f-b82f-174cbb69438b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:42.032835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:42.034640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb919a3-3b67-4e7f-b82f-174cbb69438b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:42.039459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89c522-e7fe-42f2-9a97-504239236c30 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-0cb919a3-3b67-4e7f-b82f-174cbb69438b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:42.049150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:42.050219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:42.051619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:42.051619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:42.051619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:42.051619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:42.051619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:42.051619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:42.051619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:42.051619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:42.054218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 380/746] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:42.055609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab492-6aa1-4a75-9186-da62c6aa5eef None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.056838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab492-6aa1-4a75-9186-da62c6aa5eef None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.057259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ab492-6aa1-4a75-9186-da62c6aa5eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.081725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-5c9ab492-6aa1-4a75-9186-da62c6aa5eef None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:42.083187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5c9ab492-6aa1-4a75-9186-da62c6aa5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:42.083990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d8904-b05c-4cc9-adee-25f456fcd472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:42.084688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d8904-b05c-4cc9-adee-25f456fcd472 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.085029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d8904-b05c-4cc9-adee-25f456fcd472 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.085400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d8904-b05c-4cc9-adee-25f456fcd472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.157314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d8904-b05c-4cc9-adee-25f456fcd472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:42.158789 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d8904-b05c-4cc9-adee-25f456fcd472 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:42.162683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 381/747] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:42.163791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ab492-6aa1-4a75-9186-da62c6aa5eef None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:42.245929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:42.255320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:42.266493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 367/748] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:36:42.267955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d8904-b05c-4cc9-adee-25f456fcd472 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:42.275587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ab492-6aa1-4a75-9186-da62c6aa5eef None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:42.313929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f1cca-274d-47b0-9ca6-89ce37f202ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:42.315015 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f1cca-274d-47b0-9ca6-89ce37f202ac None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.315425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f1cca-274d-47b0-9ca6-89ce37f202ac None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.315787 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f1cca-274d-47b0-9ca6-89ce37f202ac None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.316579 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f1cca-274d-47b0-9ca6-89ce37f202ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:42.316981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f1cca-274d-47b0-9ca6-89ce37f202ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:42.318514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f1cca-274d-47b0-9ca6-89ce37f202ac None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:42.332759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 382/749] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:42.348692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f1cca-274d-47b0-9ca6-89ce37f202ac None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:42.376815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d8904-b05c-4cc9-adee-25f456fcd472 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:42.418039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80712776-d8bd-4b4e-87c8-e78865668f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:42.418575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80712776-d8bd-4b4e-87c8-e78865668f45 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.418850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80712776-d8bd-4b4e-87c8-e78865668f45 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.419117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80712776-d8bd-4b4e-87c8-e78865668f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.435762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80712776-d8bd-4b4e-87c8-e78865668f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:42.437209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80712776-d8bd-4b4e-87c8-e78865668f45 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-80712776-d8bd-4b4e-87c8-e78865668f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:42.462364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:42.463398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:42.464269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:42.464269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:42.464269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:42.473210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 368/750] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:42.475456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80712776-d8bd-4b4e-87c8-e78865668f45 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:42.553349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f1cca-274d-47b0-9ca6-89ce37f202ac None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:42.598682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:42.599003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f287c73-b7f9-4c62-adf6-d516d934966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:42.599915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f287c73-b7f9-4c62-adf6-d516d934966c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.599915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f287c73-b7f9-4c62-adf6-d516d934966c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.600103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f287c73-b7f9-4c62-adf6-d516d934966c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.600803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f287c73-b7f9-4c62-adf6-d516d934966c None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=79129c52456e4455bce3179d1e056fb0) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:42.601100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f287c73-b7f9-4c62-adf6-d516d934966c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:42.602552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f287c73-b7f9-4c62-adf6-d516d934966c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:42.604538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:42.609199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 383/751] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:42 2022] GET /identity/v3/role_assignments?user.id=79129c52456e4455bce3179d1e056fb0&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:42.610832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f287c73-b7f9-4c62-adf6-d516d934966c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:42.661157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80712776-d8bd-4b4e-87c8-e78865668f45 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:42.702052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6074c-84f7-4c4f-8ccb-277bf6abb27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:42.702764 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6074c-84f7-4c4f-8ccb-277bf6abb27c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.703141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6074c-84f7-4c4f-8ccb-277bf6abb27c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.704215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6074c-84f7-4c4f-8ccb-277bf6abb27c None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.705268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6074c-84f7-4c4f-8ccb-277bf6abb27c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:42.705644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6074c-84f7-4c4f-8ccb-277bf6abb27c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:42.707156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6074c-84f7-4c4f-8ccb-277bf6abb27c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:42.726237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 369/752] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:42.735316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6074c-84f7-4c4f-8ccb-277bf6abb27c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:42.820482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f287c73-b7f9-4c62-adf6-d516d934966c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:42.859134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d904f-e2d4-47b3-95e6-040c0c129729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:42.860695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d904f-e2d4-47b3-95e6-040c0c129729 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.861181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d904f-e2d4-47b3-95e6-040c0c129729 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.861696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d904f-e2d4-47b3-95e6-040c0c129729 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.862524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d904f-e2d4-47b3-95e6-040c0c129729 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:42.872270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d904f-e2d4-47b3-95e6-040c0c129729 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:42.879766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6074c-84f7-4c4f-8ccb-277bf6abb27c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-076d904f-e2d4-47b3-95e6-040c0c129729 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:42.886156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:42.887135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:36:42.887998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:42.889941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:42.890962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 384/753] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 24 07:36:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:42.892559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed4930-b97e-454a-bdb3-2e4d07912aee None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.893044 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed4930-b97e-454a-bdb3-2e4d07912aee None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.893513 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed4930-b97e-454a-bdb3-2e4d07912aee None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.899427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 385/754] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:42.899427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed4930-b97e-454a-bdb3-2e4d07912aee None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:42.924190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33537118-ab3a-41e5-bd1f-18410c4d2347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:42.924898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33537118-ab3a-41e5-bd1f-18410c4d2347 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.925178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33537118-ab3a-41e5-bd1f-18410c4d2347 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.925443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33537118-ab3a-41e5-bd1f-18410c4d2347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.932755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33537118-ab3a-41e5-bd1f-18410c4d2347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:42.934190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33537118-ab3a-41e5-bd1f-18410c4d2347 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-33537118-ab3a-41e5-bd1f-18410c4d2347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:42.946923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:42.948357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:42.950534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:42.950534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:42.950534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:42.950534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:42.950534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:42.950534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:42.950534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:42.950534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:42.959126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 370/755] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:42.959126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa853e21-df7a-432f-8bf7-b8229661e727 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:42.959126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa853e21-df7a-432f-8bf7-b8229661e727 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:42.959126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa853e21-df7a-432f-8bf7-b8229661e727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:42.974083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-fa853e21-df7a-432f-8bf7-b8229661e727 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:42.975368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fa853e21-df7a-432f-8bf7-b8229661e727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:42.995760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:43.029135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed4930-b97e-454a-bdb3-2e4d07912aee None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:43.049508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 371/756] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:43.050447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa853e21-df7a-432f-8bf7-b8229661e727 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:43.074934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70fcfe-303a-474b-8c11-cbac198f24cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:43.075590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70fcfe-303a-474b-8c11-cbac198f24cc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.075916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70fcfe-303a-474b-8c11-cbac198f24cc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.076185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70fcfe-303a-474b-8c11-cbac198f24cc None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.076815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70fcfe-303a-474b-8c11-cbac198f24cc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:43.077164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70fcfe-303a-474b-8c11-cbac198f24cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:43.078707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70fcfe-303a-474b-8c11-cbac198f24cc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:43.088199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 386/757] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 07:36:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:43.089464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70fcfe-303a-474b-8c11-cbac198f24cc None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:43.172984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:43.177818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa853e21-df7a-432f-8bf7-b8229661e727 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:43.206534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70fcfe-303a-474b-8c11-cbac198f24cc None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:43.215925 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37cbb2-290c-4f2e-8bf3-f2e8777178d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:43.216797 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37cbb2-290c-4f2e-8bf3-f2e8777178d6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.217316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37cbb2-290c-4f2e-8bf3-f2e8777178d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.217756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37cbb2-290c-4f2e-8bf3-f2e8777178d6 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.218709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37cbb2-290c-4f2e-8bf3-f2e8777178d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:43.219792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37cbb2-290c-4f2e-8bf3-f2e8777178d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:43.221486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37cbb2-290c-4f2e-8bf3-f2e8777178d6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:43.240751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 372/758] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:43.241605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:43.243422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37cbb2-290c-4f2e-8bf3-f2e8777178d6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:43.258743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4f58-a12e-4df3-9fe4-fd979ba0fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:43.259472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4f58-a12e-4df3-9fe4-fd979ba0fa92 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.260547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4f58-a12e-4df3-9fe4-fd979ba0fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.260547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4f58-a12e-4df3-9fe4-fd979ba0fa92 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.260547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4f58-a12e-4df3-9fe4-fd979ba0fa92 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:43.260881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4f58-a12e-4df3-9fe4-fd979ba0fa92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:43.262226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a4f58-a12e-4df3-9fe4-fd979ba0fa92 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:43.273032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 387/759] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 07:36:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:43.278845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4f58-a12e-4df3-9fe4-fd979ba0fa92 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:43.416545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a4f58-a12e-4df3-9fe4-fd979ba0fa92 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:43.421356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37cbb2-290c-4f2e-8bf3-f2e8777178d6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:43.467736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54738977-f3c6-469e-b2b5-40eb98ba304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:43.468262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54738977-f3c6-469e-b2b5-40eb98ba304f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.468542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54738977-f3c6-469e-b2b5-40eb98ba304f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.468832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54738977-f3c6-469e-b2b5-40eb98ba304f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.469598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54738977-f3c6-469e-b2b5-40eb98ba304f None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=15d9847a3a5048efb19e507f988e37f4) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:43.469910 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54738977-f3c6-469e-b2b5-40eb98ba304f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:43.471345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54738977-f3c6-469e-b2b5-40eb98ba304f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:43.477848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 373/760] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:43 2022] GET /identity/v3/role_assignments?user.id=15d9847a3a5048efb19e507f988e37f4&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:43.478660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54738977-f3c6-469e-b2b5-40eb98ba304f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:43.482466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92494f6c-e35d-406d-8ce1-37c15b35fc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:43.483086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494f6c-e35d-406d-8ce1-37c15b35fc13 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.483393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494f6c-e35d-406d-8ce1-37c15b35fc13 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.483670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92494f6c-e35d-406d-8ce1-37c15b35fc13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.484387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92494f6c-e35d-406d-8ce1-37c15b35fc13 None admin] RBAC: Adding query filter params (interface=public, service_id=d02a103404754785b3d95f4e8c7ae1a3, region_id=RegionOne) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:43.485230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92494f6c-e35d-406d-8ce1-37c15b35fc13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:43.486671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92494f6c-e35d-406d-8ce1-37c15b35fc13 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:43.495954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 388/761] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 07:36:43 2022] GET /identity/v3/endpoints?service_id=d02a103404754785b3d95f4e8c7ae1a3&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:43.497300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668cdf-cbd0-41be-bafa-25b37b700643 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.497587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668cdf-cbd0-41be-bafa-25b37b700643 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.497862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668cdf-cbd0-41be-bafa-25b37b700643 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.499531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 389/762] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:43.501077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668cdf-cbd0-41be-bafa-25b37b700643 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:43.517917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:43.587572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:43.607541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54738977-f3c6-469e-b2b5-40eb98ba304f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:43.650088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668cdf-cbd0-41be-bafa-25b37b700643 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:43.653551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbabd3c-3292-4192-810b-3832929c24e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:43.654269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbabd3c-3292-4192-810b-3832929c24e4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.654619 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbabd3c-3292-4192-810b-3832929c24e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.654962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbabd3c-3292-4192-810b-3832929c24e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.666049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbabd3c-3292-4192-810b-3832929c24e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-4fbabd3c-3292-4192-810b-3832929c24e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:43.670839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:43.671762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:43.674963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 374/763] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:43.676369 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826ca57-2aef-43bc-aa2f-69cd6d33f96b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.676720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826ca57-2aef-43bc-aa2f-69cd6d33f96b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.677071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826ca57-2aef-43bc-aa2f-69cd6d33f96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.705236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b826ca57-2aef-43bc-aa2f-69cd6d33f96b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:43.706679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b826ca57-2aef-43bc-aa2f-69cd6d33f96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:43.709718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012261fc-8d26-41db-b9b2-96c6456f76de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:43.709718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012261fc-8d26-41db-b9b2-96c6456f76de None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.710920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012261fc-8d26-41db-b9b2-96c6456f76de None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.710920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012261fc-8d26-41db-b9b2-96c6456f76de None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.711517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012261fc-8d26-41db-b9b2-96c6456f76de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:43.712893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012261fc-8d26-41db-b9b2-96c6456f76de None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:43.718767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 390/764] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 07:36:43 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:43.720066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012261fc-8d26-41db-b9b2-96c6456f76de None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:43.835856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 375/765] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:43.889038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012261fc-8d26-41db-b9b2-96c6456f76de None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:43.908328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:43.927042 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff227076-e055-4111-a287-9fbe4519fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:43.927736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff227076-e055-4111-a287-9fbe4519fb76 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:43.928017 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff227076-e055-4111-a287-9fbe4519fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:43.928284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff227076-e055-4111-a287-9fbe4519fb76 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:43.928947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff227076-e055-4111-a287-9fbe4519fb76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:43.929247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff227076-e055-4111-a287-9fbe4519fb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:43.930655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff227076-e055-4111-a287-9fbe4519fb76 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:43.940332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 391/766] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:43.946090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826ca57-2aef-43bc-aa2f-69cd6d33f96b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:43.963031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:44.086530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826ca57-2aef-43bc-aa2f-69cd6d33f96b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:44.130639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab8fc3-1cb0-4f7d-b687-3db689b3023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:44.131270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab8fc3-1cb0-4f7d-b687-3db689b3023f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:44.131574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab8fc3-1cb0-4f7d-b687-3db689b3023f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:44.131845 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab8fc3-1cb0-4f7d-b687-3db689b3023f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:44.143322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab8fc3-1cb0-4f7d-b687-3db689b3023f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:44.144775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab8fc3-1cb0-4f7d-b687-3db689b3023f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-2fab8fc3-1cb0-4f7d-b687-3db689b3023f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:44.165355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:44.166317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:44.167605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:44.167605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:44.167605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:44.167605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 376/767] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:44.174255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff227076-e055-4111-a287-9fbe4519fb76 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:44.218159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab8fc3-1cb0-4f7d-b687-3db689b3023f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:44.284224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:44.323924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab8fc3-1cb0-4f7d-b687-3db689b3023f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:44.339132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff227076-e055-4111-a287-9fbe4519fb76 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:44.363587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918358-3320-4bdf-9e43-22ee3add675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:44.364489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918358-3320-4bdf-9e43-22ee3add675c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:44.364983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918358-3320-4bdf-9e43-22ee3add675c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:44.365450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918358-3320-4bdf-9e43-22ee3add675c None admin] PATH_INFO: `/v3/services/network` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:44.366222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5918358-3320-4bdf-9e43-22ee3add675c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:44.367807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5918358-3320-4bdf-9e43-22ee3add675c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-b5918358-3320-4bdf-9e43-22ee3add675c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:44.377316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:44.378273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:36:44.379104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:44.381799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 377/768] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:44 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:44.387588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918358-3320-4bdf-9e43-22ee3add675c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:44.416019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35d33e-a396-4dc7-8506-e6c1a38f5e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:44.417004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35d33e-a396-4dc7-8506-e6c1a38f5e35 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:44.417504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35d33e-a396-4dc7-8506-e6c1a38f5e35 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:44.417974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35d33e-a396-4dc7-8506-e6c1a38f5e35 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:44.419749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35d33e-a396-4dc7-8506-e6c1a38f5e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:44.420501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35d33e-a396-4dc7-8506-e6c1a38f5e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:44.424194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35d33e-a396-4dc7-8506-e6c1a38f5e35 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:44.444618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 392/769] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:44.450584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35d33e-a396-4dc7-8506-e6c1a38f5e35 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:44.522474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918358-3320-4bdf-9e43-22ee3add675c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:44.539674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:44.553876 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:44.563341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf61a0b-a10c-44d3-b7cb-44123c4545ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:44.564916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf61a0b-a10c-44d3-b7cb-44123c4545ba None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:44.565399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf61a0b-a10c-44d3-b7cb-44123c4545ba None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:44.565888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf61a0b-a10c-44d3-b7cb-44123c4545ba None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:44.566720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf61a0b-a10c-44d3-b7cb-44123c4545ba None admin] RBAC: Adding query filter params (name=network) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:44.567221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf61a0b-a10c-44d3-b7cb-44123c4545ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:44.568826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf61a0b-a10c-44d3-b7cb-44123c4545ba None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:44.574080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 378/770] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:36:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:44.580502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf61a0b-a10c-44d3-b7cb-44123c4545ba None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:44.596188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35d33e-a396-4dc7-8506-e6c1a38f5e35 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:44.631186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70c21-835b-445e-8c46-839bc336e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:44.631854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70c21-835b-445e-8c46-839bc336e68e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:44.632135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70c21-835b-445e-8c46-839bc336e68e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:44.632405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70c21-835b-445e-8c46-839bc336e68e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:44.642647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a70c21-835b-445e-8c46-839bc336e68e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:44.644493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a70c21-835b-445e-8c46-839bc336e68e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-42a70c21-835b-445e-8c46-839bc336e68e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:44.660084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:44.661080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:44.662035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 393/771] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 07:36:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:44.666056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70c21-835b-445e-8c46-839bc336e68e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:44.712998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf61a0b-a10c-44d3-b7cb-44123c4545ba None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:44.752101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbe268-2308-4d61-8f63-79c13509418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:44.753069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbe268-2308-4d61-8f63-79c13509418e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:44.753582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbe268-2308-4d61-8f63-79c13509418e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:44.754094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbe268-2308-4d61-8f63-79c13509418e None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:44.754928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbe268-2308-4d61-8f63-79c13509418e None admin] RBAC: Adding query filter params (type=network) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:44.755454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbe268-2308-4d61-8f63-79c13509418e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:44.757030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbe268-2308-4d61-8f63-79c13509418e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:44.764074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 379/772] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:36:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:44.770911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbe268-2308-4d61-8f63-79c13509418e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:44.836347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:44.885487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbe268-2308-4d61-8f63-79c13509418e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:44.924055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:44.925691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054e63b-2957-4a22-a777-d678538ad115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:44.926810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054e63b-2957-4a22-a777-d678538ad115 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:44.927308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054e63b-2957-4a22-a777-d678538ad115 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:44.932097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054e63b-2957-4a22-a777-d678538ad115 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:44.932097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054e63b-2957-4a22-a777-d678538ad115 None admin] RBAC: Adding query filter params (interface=public, service_id=50fdaaebcdc74a808abda7e81a2156e7, region_id=RegionOne) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:44.932097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054e63b-2957-4a22-a777-d678538ad115 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:44.932363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70c21-835b-445e-8c46-839bc336e68e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:44.932438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054e63b-2957-4a22-a777-d678538ad115 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:44.938888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 380/773] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 07:36:44 2022] GET /identity/v3/endpoints?service_id=50fdaaebcdc74a808abda7e81a2156e7&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:44.944456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054e63b-2957-4a22-a777-d678538ad115 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:44.996995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0aaa-1065-45f9-99b9-44f3ae113b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:44.998174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0aaa-1065-45f9-99b9-44f3ae113b9b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:44.998630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0aaa-1065-45f9-99b9-44f3ae113b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:44.999262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0aaa-1065-45f9-99b9-44f3ae113b9b None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.000691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0aaa-1065-45f9-99b9-44f3ae113b9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:45.001176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0aaa-1065-45f9-99b9-44f3ae113b9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:45.003341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0aaa-1065-45f9-99b9-44f3ae113b9b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:45.027997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 394/774] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 07:36:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:45.029923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688ed51-4ea7-4dbd-9e49-50a6e1c28b8c None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.030427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688ed51-4ea7-4dbd-9e49-50a6e1c28b8c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.030878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688ed51-4ea7-4dbd-9e49-50a6e1c28b8c None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.037189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 395/775] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:45.037189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688ed51-4ea7-4dbd-9e49-50a6e1c28b8c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:45.063398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054e63b-2957-4a22-a777-d678538ad115 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:45.085450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:45.100619 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac961a0-9427-415a-9c12-01269164b5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:45.101275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac961a0-9427-415a-9c12-01269164b5d9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.101538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac961a0-9427-415a-9c12-01269164b5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.101815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac961a0-9427-415a-9c12-01269164b5d9 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.102474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac961a0-9427-415a-9c12-01269164b5d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:45.103928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac961a0-9427-415a-9c12-01269164b5d9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:45.115465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 381/776] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 07:36:44 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:45.116939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88b64e-9bf4-4f50-8c9b-9e68a0ff7d17 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.117276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88b64e-9bf4-4f50-8c9b-9e68a0ff7d17 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.117693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88b64e-9bf4-4f50-8c9b-9e68a0ff7d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.163647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8a88b64e-9bf4-4f50-8c9b-9e68a0ff7d17 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:45.163647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8a88b64e-9bf4-4f50-8c9b-9e68a0ff7d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:45.201400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688ed51-4ea7-4dbd-9e49-50a6e1c28b8c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:45.281267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5872e-ca97-4544-a987-580dc7776939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:45.282451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5872e-ca97-4544-a987-580dc7776939 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.282733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5872e-ca97-4544-a987-580dc7776939 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.283007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5872e-ca97-4544-a987-580dc7776939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.286421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 382/777] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:45.299382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5872e-ca97-4544-a987-580dc7776939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:45.301424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5872e-ca97-4544-a987-580dc7776939 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-1dd5872e-ca97-4544-a987-580dc7776939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:45.317311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:45.318256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:45.319132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:45.319132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:45.319132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:45.321255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 396/778] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:45.326690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88b64e-9bf4-4f50-8c9b-9e68a0ff7d17 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:45.436480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88b64e-9bf4-4f50-8c9b-9e68a0ff7d17 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:45.451443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:45.472399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89145f-ef59-4fc9-a7b9-af814c838bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:45.473013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89145f-ef59-4fc9-a7b9-af814c838bad None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.473293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89145f-ef59-4fc9-a7b9-af814c838bad None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.473564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89145f-ef59-4fc9-a7b9-af814c838bad None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.474208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89145f-ef59-4fc9-a7b9-af814c838bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:45.474509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89145f-ef59-4fc9-a7b9-af814c838bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:45.475907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89145f-ef59-4fc9-a7b9-af814c838bad None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:45.488134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 383/779] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:45.493526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5872e-ca97-4544-a987-580dc7776939 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:45.518421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:45.596737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89145f-ef59-4fc9-a7b9-af814c838bad None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:45.657060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5872e-ca97-4544-a987-580dc7776939 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:45.714116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b48d7b-6041-4593-a6d9-e2f44519158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:45.715391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b48d7b-6041-4593-a6d9-e2f44519158e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.716760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b48d7b-6041-4593-a6d9-e2f44519158e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.717248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b48d7b-6041-4593-a6d9-e2f44519158e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.726419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b48d7b-6041-4593-a6d9-e2f44519158e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:45.727907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b48d7b-6041-4593-a6d9-e2f44519158e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-e0b48d7b-6041-4593-a6d9-e2f44519158e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:45.742359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:45.743333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:45.744238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:45.744238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:45.744238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:45.744238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:45.744238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:45.744238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:45.744238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:45.744238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:45.748134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 397/780] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:45.749504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55eb8-8ad3-4f27-a3b3-c42bdf89b469 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.749702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55eb8-8ad3-4f27-a3b3-c42bdf89b469 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.749969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55eb8-8ad3-4f27-a3b3-c42bdf89b469 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.752395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 398/781] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:45.756584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55eb8-8ad3-4f27-a3b3-c42bdf89b469 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:45.764405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89145f-ef59-4fc9-a7b9-af814c838bad None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:45.803413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061e100-7abb-4944-aa22-58c38a3a01b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:45.804214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061e100-7abb-4944-aa22-58c38a3a01b5 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.804595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061e100-7abb-4944-aa22-58c38a3a01b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.804970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061e100-7abb-4944-aa22-58c38a3a01b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.816475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061e100-7abb-4944-aa22-58c38a3a01b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-a061e100-7abb-4944-aa22-58c38a3a01b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:45.822082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:45.823938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:45.825645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:45.832023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 384/782] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:45.833633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b155-5810-4d2c-8b37-77a7b2dcebb2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.834009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b155-5810-4d2c-8b37-77a7b2dcebb2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.834396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b155-5810-4d2c-8b37-77a7b2dcebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.845553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:45.859317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7dc8b155-5810-4d2c-8b37-77a7b2dcebb2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:45.861124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7dc8b155-5810-4d2c-8b37-77a7b2dcebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:45.883618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55eb8-8ad3-4f27-a3b3-c42bdf89b469 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:45.891679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:45.921058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00c0a6-32c4-4934-a399-b8df569c7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:45.921935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00c0a6-32c4-4934-a399-b8df569c7915 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:45.922499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00c0a6-32c4-4934-a399-b8df569c7915 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:45.922980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00c0a6-32c4-4934-a399-b8df569c7915 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:45.923843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00c0a6-32c4-4934-a399-b8df569c7915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:45.924325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00c0a6-32c4-4934-a399-b8df569c7915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:45.926160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00c0a6-32c4-4934-a399-b8df569c7915 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:45.940894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 399/783] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:45.942056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00c0a6-32c4-4934-a399-b8df569c7915 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:45.943709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 385/784] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:45.946804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b155-5810-4d2c-8b37-77a7b2dcebb2 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:46.047927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00c0a6-32c4-4934-a399-b8df569c7915 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:46.080448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:46.096091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668230a-8a7b-4814-9d07-52f23fd11d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:46.097149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668230a-8a7b-4814-9d07-52f23fd11d62 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:46.097727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668230a-8a7b-4814-9d07-52f23fd11d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:46.098198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668230a-8a7b-4814-9d07-52f23fd11d62 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:46.099069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668230a-8a7b-4814-9d07-52f23fd11d62 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:46.103720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668230a-8a7b-4814-9d07-52f23fd11d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:46.107841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668230a-8a7b-4814-9d07-52f23fd11d62 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:46.124529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b155-5810-4d2c-8b37-77a7b2dcebb2 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:46.127016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 400/785] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:46.132717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668230a-8a7b-4814-9d07-52f23fd11d62 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:46.197036 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b346e7f-38be-42c2-a622-34abc71b3fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:46.197701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b346e7f-38be-42c2-a622-34abc71b3fbd None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:46.197981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b346e7f-38be-42c2-a622-34abc71b3fbd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:46.198257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b346e7f-38be-42c2-a622-34abc71b3fbd None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/7d8054e88916456991bf485c19f8b502/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:46.200955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b346e7f-38be-42c2-a622-34abc71b3fbd None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=7d8054e88916456991bf485c19f8b502, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:46.204712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b346e7f-38be-42c2-a622-34abc71b3fbd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:46.265154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 386/786] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:36:45 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/7d8054e88916456991bf485c19f8b502/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:36:46.339888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d444-0d25-4009-be7c-68730ca21494 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:46.340061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d444-0d25-4009-be7c-68730ca21494 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:46.340376 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d444-0d25-4009-be7c-68730ca21494 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:46.342037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 387/787] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:36:46.345877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6d444-0d25-4009-be7c-68730ca21494 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:46.355744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668230a-8a7b-4814-9d07-52f23fd11d62 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:46.390222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:46.418022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7373af-fff0-43d5-bdbc-b239235bf745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:46.418680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7373af-fff0-43d5-bdbc-b239235bf745 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:46.419053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7373af-fff0-43d5-bdbc-b239235bf745 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:46.419419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7373af-fff0-43d5-bdbc-b239235bf745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:46.440506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7373af-fff0-43d5-bdbc-b239235bf745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:46.441996 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7373af-fff0-43d5-bdbc-b239235bf745 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-8e7373af-fff0-43d5-bdbc-b239235bf745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:46.464156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:46.465124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:46.466550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:46.466550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:46.466550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:46.466550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 401/788] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:46.466772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6fac9-617d-4dbc-a9b9-6036162fb1f5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:46.467054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6fac9-617d-4dbc-a9b9-6036162fb1f5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:46.471312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6fac9-617d-4dbc-a9b9-6036162fb1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:46.491427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-41f6fac9-617d-4dbc-a9b9-6036162fb1f5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:46.492808 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-41f6fac9-617d-4dbc-a9b9-6036162fb1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:46.517068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6d444-0d25-4009-be7c-68730ca21494 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:46.547259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:46.565804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69ad47-cdf3-498b-ac05-7afafb5e1aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:46.577114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69ad47-cdf3-498b-ac05-7afafb5e1aae None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:46.577114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69ad47-cdf3-498b-ac05-7afafb5e1aae None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:46.577114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69ad47-cdf3-498b-ac05-7afafb5e1aae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:46.579596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 402/789] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:46.580611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6fac9-617d-4dbc-a9b9-6036162fb1f5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:46.581371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69ad47-cdf3-498b-ac05-7afafb5e1aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-be69ad47-cdf3-498b-ac05-7afafb5e1aae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:46.586251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:46.587142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:46.588111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:46.590823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 388/790] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:46.603852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69ad47-cdf3-498b-ac05-7afafb5e1aae None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:46.738138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6fac9-617d-4dbc-a9b9-6036162fb1f5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:46.777230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:46.784949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b16eb-7a3e-45dd-8eb7-74664842e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:46.785566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b16eb-7a3e-45dd-8eb7-74664842e69b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:46.785843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b16eb-7a3e-45dd-8eb7-74664842e69b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:46.786111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b16eb-7a3e-45dd-8eb7-74664842e69b None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:46.791488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b16eb-7a3e-45dd-8eb7-74664842e69b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:46.791488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b16eb-7a3e-45dd-8eb7-74664842e69b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:46.791488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b16eb-7a3e-45dd-8eb7-74664842e69b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:46.795936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69ad47-cdf3-498b-ac05-7afafb5e1aae None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:46.805473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 403/791] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:46.810984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b16eb-7a3e-45dd-8eb7-74664842e69b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:46.865889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4888c-70d1-4b43-8f34-761624de89ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:46.866425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4888c-70d1-4b43-8f34-761624de89ba None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:46.866988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4888c-70d1-4b43-8f34-761624de89ba None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:46.867267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4888c-70d1-4b43-8f34-761624de89ba None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:46.867966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4888c-70d1-4b43-8f34-761624de89ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:46.868274 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4888c-70d1-4b43-8f34-761624de89ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:46.872474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4888c-70d1-4b43-8f34-761624de89ba None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:46.881921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:46.891742 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 389/792] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:46.901076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4888c-70d1-4b43-8f34-761624de89ba None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:46.955666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b16eb-7a3e-45dd-8eb7-74664842e69b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:46.993163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e741e-6e6f-4fd1-a249-2446f1647b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:46.994082 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e741e-6e6f-4fd1-a249-2446f1647b18 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:46.994429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e741e-6e6f-4fd1-a249-2446f1647b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:46.994807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e741e-6e6f-4fd1-a249-2446f1647b18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.003575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e741e-6e6f-4fd1-a249-2446f1647b18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.005231 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e741e-6e6f-4fd1-a249-2446f1647b18 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-526e741e-6e6f-4fd1-a249-2446f1647b18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:47.017032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:47.017983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:47.018922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 404/793] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:36:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:47.019532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e741e-6e6f-4fd1-a249-2446f1647b18 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.040681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4888c-70d1-4b43-8f34-761624de89ba None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.079856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c72dc-db5b-48b2-9249-16d974f4c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.081121 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c72dc-db5b-48b2-9249-16d974f4c91d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.081979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c72dc-db5b-48b2-9249-16d974f4c91d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.082444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c72dc-db5b-48b2-9249-16d974f4c91d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.097633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c72dc-db5b-48b2-9249-16d974f4c91d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.100258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c72dc-db5b-48b2-9249-16d974f4c91d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.108895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-d51c72dc-db5b-48b2-9249-16d974f4c91d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:47.126297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:47.127264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:47.128170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:47.128170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:47.128170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:47.128170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 390/794] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:47.128170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c72dc-db5b-48b2-9249-16d974f4c91d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.143781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:47.153594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e741e-6e6f-4fd1-a249-2446f1647b18 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.204539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79612-eaf3-4332-96d6-b548de0f8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.205689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79612-eaf3-4332-96d6-b548de0f8cd9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.206973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79612-eaf3-4332-96d6-b548de0f8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.207455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79612-eaf3-4332-96d6-b548de0f8cd9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.208196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e79612-eaf3-4332-96d6-b548de0f8cd9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.209729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e79612-eaf3-4332-96d6-b548de0f8cd9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-66e79612-eaf3-4332-96d6-b548de0f8cd9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:47.222413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:47.223649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:36:47.224696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:47.227035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 405/795] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 24 07:36:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:47.227986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79612-eaf3-4332-96d6-b548de0f8cd9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.246330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c72dc-db5b-48b2-9249-16d974f4c91d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.285474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f047e-2ec4-4214-bf1e-352147223bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.286083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f047e-2ec4-4214-bf1e-352147223bed None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.286463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f047e-2ec4-4214-bf1e-352147223bed None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.286832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f047e-2ec4-4214-bf1e-352147223bed None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.287714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f047e-2ec4-4214-bf1e-352147223bed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:47.288117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f047e-2ec4-4214-bf1e-352147223bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.289652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f047e-2ec4-4214-bf1e-352147223bed None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.308635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 391/796] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 07:36:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:47.309785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f047e-2ec4-4214-bf1e-352147223bed None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.379342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:47.380783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79612-eaf3-4332-96d6-b548de0f8cd9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.421306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3996aa6-1a15-42c0-ad2e-34e4217e117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.422911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3996aa6-1a15-42c0-ad2e-34e4217e117e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.423204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3996aa6-1a15-42c0-ad2e-34e4217e117e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.423502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3996aa6-1a15-42c0-ad2e-34e4217e117e None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.424334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3996aa6-1a15-42c0-ad2e-34e4217e117e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:47.424639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3996aa6-1a15-42c0-ad2e-34e4217e117e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.426876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3996aa6-1a15-42c0-ad2e-34e4217e117e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.428247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f047e-2ec4-4214-bf1e-352147223bed None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.439808 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 406/797] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:47.440657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3996aa6-1a15-42c0-ad2e-34e4217e117e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.461161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:47.470594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a17fa4-34ff-4187-b923-11ee04ffe26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.471202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17fa4-34ff-4187-b923-11ee04ffe26d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.471508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17fa4-34ff-4187-b923-11ee04ffe26d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.475318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17fa4-34ff-4187-b923-11ee04ffe26d None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.475318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a17fa4-34ff-4187-b923-11ee04ffe26d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:47.475318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a17fa4-34ff-4187-b923-11ee04ffe26d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.475318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a17fa4-34ff-4187-b923-11ee04ffe26d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.478907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 392/798] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 07:36:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:47.485112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1787b9-65c1-43c8-9101-96d0d5a6daf4 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.485689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1787b9-65c1-43c8-9101-96d0d5a6daf4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.485689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1787b9-65c1-43c8-9101-96d0d5a6daf4 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.491047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 393/799] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:47.491047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1787b9-65c1-43c8-9101-96d0d5a6daf4 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.555511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3996aa6-1a15-42c0-ad2e-34e4217e117e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.595509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1787b9-65c1-43c8-9101-96d0d5a6daf4 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.599641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a932440-04c1-4369-acf3-90f6dded11e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.600350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a932440-04c1-4369-acf3-90f6dded11e2 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.600703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a932440-04c1-4369-acf3-90f6dded11e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.601049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a932440-04c1-4369-acf3-90f6dded11e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.613379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a932440-04c1-4369-acf3-90f6dded11e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.614901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a932440-04c1-4369-acf3-90f6dded11e2 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.618735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-4a932440-04c1-4369-acf3-90f6dded11e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:47.631450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:47.632702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:47.633878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:47.633878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:47.633878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:47.633878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 407/800] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:47.633878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a932440-04c1-4369-acf3-90f6dded11e2 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.637155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd7828-802b-4914-ac1a-5b64c44a86e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.637855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd7828-802b-4914-ac1a-5b64c44a86e2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.638204 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd7828-802b-4914-ac1a-5b64c44a86e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.638526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd7828-802b-4914-ac1a-5b64c44a86e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.645773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd7828-802b-4914-ac1a-5b64c44a86e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.647194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd7828-802b-4914-ac1a-5b64c44a86e2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-06cd7828-802b-4914-ac1a-5b64c44a86e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:47.660250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:47.666297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 394/801] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cad1f-4679-49d3-aa14-556e008f3184 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.667513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cad1f-4679-49d3-aa14-556e008f3184 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.668360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cad1f-4679-49d3-aa14-556e008f3184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.680885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-589cad1f-4679-49d3-aa14-556e008f3184 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:47.682100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-589cad1f-4679-49d3-aa14-556e008f3184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:47.718433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:47.755515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 395/802] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:47.755515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cad1f-4679-49d3-aa14-556e008f3184 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.761085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a932440-04c1-4369-acf3-90f6dded11e2 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.804171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9c81-807c-4f86-8ac3-85c61a6acad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.805021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9c81-807c-4f86-8ac3-85c61a6acad9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.805313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9c81-807c-4f86-8ac3-85c61a6acad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.805590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9c81-807c-4f86-8ac3-85c61a6acad9 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.806678 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee9c81-807c-4f86-8ac3-85c61a6acad9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:47.806988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee9c81-807c-4f86-8ac3-85c61a6acad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.808662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee9c81-807c-4f86-8ac3-85c61a6acad9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.819314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 408/803] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 24 07:36:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:47.819314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9c81-807c-4f86-8ac3-85c61a6acad9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.867128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cad1f-4679-49d3-aa14-556e008f3184 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.880934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:47.908233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f37b5-8a95-4bd2-914c-0bde8564c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.908754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f37b5-8a95-4bd2-914c-0bde8564c011 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.909034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f37b5-8a95-4bd2-914c-0bde8564c011 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:47.909300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f37b5-8a95-4bd2-914c-0bde8564c011 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:47.909938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f37b5-8a95-4bd2-914c-0bde8564c011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:47.910236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f37b5-8a95-4bd2-914c-0bde8564c011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:47.911635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f37b5-8a95-4bd2-914c-0bde8564c011 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:47.929786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 396/804] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:47.930643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f37b5-8a95-4bd2-914c-0bde8564c011 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:47.948604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9c81-807c-4f86-8ac3-85c61a6acad9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:47.998805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c29a5-dfa7-41b5-a118-5db1d0ecbb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:47.999441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c29a5-dfa7-41b5-a118-5db1d0ecbb61 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:47.999725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c29a5-dfa7-41b5-a118-5db1d0ecbb61 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.000038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c29a5-dfa7-41b5-a118-5db1d0ecbb61 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.000815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c29a5-dfa7-41b5-a118-5db1d0ecbb61 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:48.001115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c29a5-dfa7-41b5-a118-5db1d0ecbb61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.002665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c29a5-dfa7-41b5-a118-5db1d0ecbb61 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.004652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:48.022601 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 409/805] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 07:36:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:48.024284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c29a5-dfa7-41b5-a118-5db1d0ecbb61 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:48.059631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f37b5-8a95-4bd2-914c-0bde8564c011 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:48.097152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544c648-0532-4ef2-a6a4-71c955519496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:48.098157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544c648-0532-4ef2-a6a4-71c955519496 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.098157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544c648-0532-4ef2-a6a4-71c955519496 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.098349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544c648-0532-4ef2-a6a4-71c955519496 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.098914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544c648-0532-4ef2-a6a4-71c955519496 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.100301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544c648-0532-4ef2-a6a4-71c955519496 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.128791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c29a5-dfa7-41b5-a118-5db1d0ecbb61 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:48.164465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e93b8f-c537-432e-88fa-d27ec5371f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:48.165015 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e93b8f-c537-432e-88fa-d27ec5371f12 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.165288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e93b8f-c537-432e-88fa-d27ec5371f12 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.165561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e93b8f-c537-432e-88fa-d27ec5371f12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.172753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e93b8f-c537-432e-88fa-d27ec5371f12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.174308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e93b8f-c537-432e-88fa-d27ec5371f12 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-10e93b8f-c537-432e-88fa-d27ec5371f12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:48.185457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:48.187158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 410/806] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:48.188229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e93b8f-c537-432e-88fa-d27ec5371f12 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:48.227317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 397/807] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:36:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:48.227317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544c648-0532-4ef2-a6a4-71c955519496 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:48.254050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:48.261988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:48.319115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e93b8f-c537-432e-88fa-d27ec5371f12 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:48.377310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544c648-0532-4ef2-a6a4-71c955519496 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:48.384117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedcf01-0025-4f69-8c06-b491ecf3eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:48.384759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedcf01-0025-4f69-8c06-b491ecf3eb38 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.385032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedcf01-0025-4f69-8c06-b491ecf3eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.385297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedcf01-0025-4f69-8c06-b491ecf3eb38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.397197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedcf01-0025-4f69-8c06-b491ecf3eb38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.398651 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedcf01-0025-4f69-8c06-b491ecf3eb38 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.414898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269c97a-ad14-4a10-b840-26b64c144d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-fcedcf01-0025-4f69-8c06-b491ecf3eb38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:48.415271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:48.416172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:48.417066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:48.417066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:48.417066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:48.417233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269c97a-ad14-4a10-b840-26b64c144d26 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.417233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269c97a-ad14-4a10-b840-26b64c144d26 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.417233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269c97a-ad14-4a10-b840-26b64c144d26 None admin] PATH_INFO: `/v3/services/network` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.417426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 411/808] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:48.417494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269c97a-ad14-4a10-b840-26b64c144d26 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.417559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedcf01-0025-4f69-8c06-b491ecf3eb38 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:48.417927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269c97a-ad14-4a10-b840-26b64c144d26 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-b269c97a-ad14-4a10-b840-26b64c144d26 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:48.428512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:48.429771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:48.430686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 398/809] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:48 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:48.431667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda5367-907c-43a2-8be6-ed9240cb9512 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.431667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda5367-907c-43a2-8be6-ed9240cb9512 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.431667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda5367-907c-43a2-8be6-ed9240cb9512 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.432937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 399/810] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:48.433488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda5367-907c-43a2-8be6-ed9240cb9512 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:48.525738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:48.528008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:48.530833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedcf01-0025-4f69-8c06-b491ecf3eb38 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:48.546061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda5367-907c-43a2-8be6-ed9240cb9512 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:48.565705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2565f61-54fa-41fe-af37-961e11774973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:48.566401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2565f61-54fa-41fe-af37-961e11774973 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.566753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2565f61-54fa-41fe-af37-961e11774973 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.567022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2565f61-54fa-41fe-af37-961e11774973 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.567733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2565f61-54fa-41fe-af37-961e11774973 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:48.568038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2565f61-54fa-41fe-af37-961e11774973 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.569461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2565f61-54fa-41fe-af37-961e11774973 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.582476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 412/811] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:48.582888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565f515-e210-4d7f-8083-dc39da1685b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:48.583420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2565f61-54fa-41fe-af37-961e11774973 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:48.587195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565f515-e210-4d7f-8083-dc39da1685b8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.587195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565f515-e210-4d7f-8083-dc39da1685b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.587195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565f515-e210-4d7f-8083-dc39da1685b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.587195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565f515-e210-4d7f-8083-dc39da1685b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:48.587195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565f515-e210-4d7f-8083-dc39da1685b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.587195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565f515-e210-4d7f-8083-dc39da1685b8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.600170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 400/812] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:48.601624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96f6fe-bed8-4642-b424-1d5fc6137490 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.602009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96f6fe-bed8-4642-b424-1d5fc6137490 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.602422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96f6fe-bed8-4642-b424-1d5fc6137490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.621042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-dc96f6fe-bed8-4642-b424-1d5fc6137490 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:48.622226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-dc96f6fe-bed8-4642-b424-1d5fc6137490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:48.699432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 401/813] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:48.699432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96f6fe-bed8-4642-b424-1d5fc6137490 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:48.721347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2565f61-54fa-41fe-af37-961e11774973 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:48.772966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318c6f-cf09-42b6-94ec-910cbc076b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:48.773976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318c6f-cf09-42b6-94ec-910cbc076b39 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.774480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318c6f-cf09-42b6-94ec-910cbc076b39 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.774958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318c6f-cf09-42b6-94ec-910cbc076b39 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.775858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10318c6f-cf09-42b6-94ec-910cbc076b39 None admin] RBAC: Adding query filter params (name=network) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:48.776889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10318c6f-cf09-42b6-94ec-910cbc076b39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.778496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:48.779816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10318c6f-cf09-42b6-94ec-910cbc076b39 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.786704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 413/814] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:36:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:48.788172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318c6f-cf09-42b6-94ec-910cbc076b39 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:48.814843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96f6fe-bed8-4642-b424-1d5fc6137490 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:48.832134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:48.868579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3df83-080e-45a8-a6f2-92845373532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:48.869882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3df83-080e-45a8-a6f2-92845373532b None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.870533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3df83-080e-45a8-a6f2-92845373532b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.871380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3df83-080e-45a8-a6f2-92845373532b None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/79129c52456e4455bce3179d1e056fb0/roles/f9846b0a2b8b45739e904a66fad55771` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.891333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3df83-080e-45a8-a6f2-92845373532b None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=79129c52456e4455bce3179d1e056fb0, role_id=f9846b0a2b8b45739e904a66fad55771)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.893634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3df83-080e-45a8-a6f2-92845373532b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.918389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318c6f-cf09-42b6-94ec-910cbc076b39 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:48.957109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb19ee3-935b-41bf-9b9d-b6b77c5f7795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:48.957659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb19ee3-935b-41bf-9b9d-b6b77c5f7795 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:48.957937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb19ee3-935b-41bf-9b9d-b6b77c5f7795 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:48.958226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb19ee3-935b-41bf-9b9d-b6b77c5f7795 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:48.964909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb19ee3-935b-41bf-9b9d-b6b77c5f7795 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:48.966473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb19ee3-935b-41bf-9b9d-b6b77c5f7795 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:48.975085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 402/815] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:36:48 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/79129c52456e4455bce3179d1e056fb0/roles/f9846b0a2b8b45739e904a66fad55771 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:36:48.976320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3df83-080e-45a8-a6f2-92845373532b None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-9cb19ee3-935b-41bf-9b9d-b6b77c5f7795 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:48.981191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:48.987891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 414/816] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:48.997815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb19ee3-935b-41bf-9b9d-b6b77c5f7795 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:49.087810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:49.106336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb19ee3-935b-41bf-9b9d-b6b77c5f7795 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:49.120300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3df83-080e-45a8-a6f2-92845373532b None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:49.154180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35088eb8-f373-4f4e-8f00-8e6b238cd654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:49.154829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35088eb8-f373-4f4e-8f00-8e6b238cd654 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:49.155117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35088eb8-f373-4f4e-8f00-8e6b238cd654 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:49.157304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:49.159085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35088eb8-f373-4f4e-8f00-8e6b238cd654 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:49.170194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d287d-02a2-42ea-a8a4-4bb68900f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:49.170881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35088eb8-f373-4f4e-8f00-8e6b238cd654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:49.171060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d287d-02a2-42ea-a8a4-4bb68900f1bd None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:49.171325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d287d-02a2-42ea-a8a4-4bb68900f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:49.171647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d287d-02a2-42ea-a8a4-4bb68900f1bd None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:49.172798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d287d-02a2-42ea-a8a4-4bb68900f1bd None admin] RBAC: Adding query filter params (type=network) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:49.173105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d287d-02a2-42ea-a8a4-4bb68900f1bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:49.174548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d287d-02a2-42ea-a8a4-4bb68900f1bd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-35088eb8-f373-4f4e-8f00-8e6b238cd654 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:49.176574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:49.177508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:49.178340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 415/817] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:49.179691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35088eb8-f373-4f4e-8f00-8e6b238cd654 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:49.191182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 403/818] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:36:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:49.192383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d287d-02a2-42ea-a8a4-4bb68900f1bd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:49.306908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35088eb8-f373-4f4e-8f00-8e6b238cd654 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:49.328706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d287d-02a2-42ea-a8a4-4bb68900f1bd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:49.352005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1032-7fb6-456e-871b-c480626893fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:49.352619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1032-7fb6-456e-871b-c480626893fc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:49.352893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1032-7fb6-456e-871b-c480626893fc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:49.353166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1032-7fb6-456e-871b-c480626893fc None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:49.356658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a1032-7fb6-456e-871b-c480626893fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:49.356658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a1032-7fb6-456e-871b-c480626893fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:49.359634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a1032-7fb6-456e-871b-c480626893fc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:49.370756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68df19b-b654-4621-aed9-3d0c87aaef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:49.372175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68df19b-b654-4621-aed9-3d0c87aaef0b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:49.372823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68df19b-b654-4621-aed9-3d0c87aaef0b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:49.373200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68df19b-b654-4621-aed9-3d0c87aaef0b None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:49.373995 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68df19b-b654-4621-aed9-3d0c87aaef0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:49.374686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68df19b-b654-4621-aed9-3d0c87aaef0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:49.374834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 416/819] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:49.375417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1032-7fb6-456e-871b-c480626893fc None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:49.380662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68df19b-b654-4621-aed9-3d0c87aaef0b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:49.384467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:49.394822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 404/820] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:49.397642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68df19b-b654-4621-aed9-3d0c87aaef0b None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:49.472536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:49.499551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1032-7fb6-456e-871b-c480626893fc None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:49.532270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68df19b-b654-4621-aed9-3d0c87aaef0b None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:49.549550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406460ce-7d29-4e3f-8b4c-093dc0c91f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:49.550194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406460ce-7d29-4e3f-8b4c-093dc0c91f33 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:49.551265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406460ce-7d29-4e3f-8b4c-093dc0c91f33 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:49.551648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406460ce-7d29-4e3f-8b4c-093dc0c91f33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:49.552321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406460ce-7d29-4e3f-8b4c-093dc0c91f33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:49.554237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406460ce-7d29-4e3f-8b4c-093dc0c91f33 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:49.575853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9451f-f95b-48b6-9a7d-345145facf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:49.576841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9451f-f95b-48b6-9a7d-345145facf8e None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:49.577357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9451f-f95b-48b6-9a7d-345145facf8e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:49.578373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9451f-f95b-48b6-9a7d-345145facf8e None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/15d9847a3a5048efb19e507f988e37f4/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:49.580557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9451f-f95b-48b6-9a7d-345145facf8e None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=15d9847a3a5048efb19e507f988e37f4, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:49.582307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9451f-f95b-48b6-9a7d-345145facf8e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:49.643314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 417/821] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:36:49 2022] POST /identity/v3/endpoints => generated 337 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:49.643314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406460ce-7d29-4e3f-8b4c-093dc0c91f33 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:49.667327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 405/822] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:36:49 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/15d9847a3a5048efb19e507f988e37f4/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:36:49.746337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:49.810845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406460ce-7d29-4e3f-8b4c-093dc0c91f33 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:49.860091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e527ac-fdd1-4392-8f79-6455365dd93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:49.860532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e527ac-fdd1-4392-8f79-6455365dd93f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:49.860815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e527ac-fdd1-4392-8f79-6455365dd93f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:49.861089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e527ac-fdd1-4392-8f79-6455365dd93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:49.876469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e527ac-fdd1-4392-8f79-6455365dd93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:49.877957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e527ac-fdd1-4392-8f79-6455365dd93f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-29e527ac-fdd1-4392-8f79-6455365dd93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:49.896275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:49.897262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:49.898166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:49.898166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:49.898166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:49.902289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 418/823] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:49.908523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9451f-f95b-48b6-9a7d-345145facf8e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:50.028814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9451f-f95b-48b6-9a7d-345145facf8e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:50.042683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:50.066465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87986b2-a9cc-4a1f-8a85-dde3742e5393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:50.067092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87986b2-a9cc-4a1f-8a85-dde3742e5393 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:50.067401 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87986b2-a9cc-4a1f-8a85-dde3742e5393 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:50.067676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87986b2-a9cc-4a1f-8a85-dde3742e5393 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:50.068318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87986b2-a9cc-4a1f-8a85-dde3742e5393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:50.068620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87986b2-a9cc-4a1f-8a85-dde3742e5393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:50.069984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87986b2-a9cc-4a1f-8a85-dde3742e5393 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:50.082765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 406/824] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:50.088358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e527ac-fdd1-4392-8f79-6455365dd93f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:50.206050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e527ac-fdd1-4392-8f79-6455365dd93f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:50.215412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:50.243578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5e7e6-2926-4ac2-9643-2bfe7bad765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:50.244221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5e7e6-2926-4ac2-9643-2bfe7bad765f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:50.244506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5e7e6-2926-4ac2-9643-2bfe7bad765f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:50.244788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5e7e6-2926-4ac2-9643-2bfe7bad765f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:50.288526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c71a11-9d2f-4fa2-8df9-8a4f02ac8fe0 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:50.288841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c71a11-9d2f-4fa2-8df9-8a4f02ac8fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:50.289083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c71a11-9d2f-4fa2-8df9-8a4f02ac8fe0 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:50.290471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 407/825] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:50.297389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ae0d3-9ac2-490f-9352-1e032a07e7cf None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:50.297719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ae0d3-9ac2-490f-9352-1e032a07e7cf None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:50.297942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ae0d3-9ac2-490f-9352-1e032a07e7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:50.317970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-de7ae0d3-9ac2-490f-9352-1e032a07e7cf None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:50.319177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-de7ae0d3-9ac2-490f-9352-1e032a07e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:50.373164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5e7e6-2926-4ac2-9643-2bfe7bad765f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:50.374690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5e7e6-2926-4ac2-9643-2bfe7bad765f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-70f5e7e6-2926-4ac2-9643-2bfe7bad765f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:50.386963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:50.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:36:50.391828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:50.395416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 419/826] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 07:36:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:50.395416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5e7e6-2926-4ac2-9643-2bfe7bad765f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:50.411964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 408/827] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:36:50.504372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5e7e6-2926-4ac2-9643-2bfe7bad765f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:50.541000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf43f8-c540-467a-b29f-faa999aee06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:50.541868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf43f8-c540-467a-b29f-faa999aee06d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:50.542295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf43f8-c540-467a-b29f-faa999aee06d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:50.542722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf43f8-c540-467a-b29f-faa999aee06d None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:50.543621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf43f8-c540-467a-b29f-faa999aee06d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:50.544070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf43f8-c540-467a-b29f-faa999aee06d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:50.545657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf43f8-c540-467a-b29f-faa999aee06d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:50.569195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 420/828] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 07:36:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:50.570744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ae0d3-9ac2-490f-9352-1e032a07e7cf None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:50.675885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ae0d3-9ac2-490f-9352-1e032a07e7cf None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:50.677386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:50.684161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf43f8-c540-467a-b29f-faa999aee06d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:50.716572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:50.719706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9261a-32af-446a-b9b4-29f120384d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:50.720627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9261a-32af-446a-b9b4-29f120384d57 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:50.720918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9261a-32af-446a-b9b4-29f120384d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:50.721194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9261a-32af-446a-b9b4-29f120384d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:50.803730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9261a-32af-446a-b9b4-29f120384d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:50.805095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9261a-32af-446a-b9b4-29f120384d57 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:50.805365 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf43f8-c540-467a-b29f-faa999aee06d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:50.841241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5307-9f2a-4632-8f3b-44136a626d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:50.842237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5307-9f2a-4632-8f3b-44136a626d3c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:50.842735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5307-9f2a-4632-8f3b-44136a626d3c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:50.843202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5307-9f2a-4632-8f3b-44136a626d3c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:50.844777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec5307-9f2a-4632-8f3b-44136a626d3c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:50.846795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec5307-9f2a-4632-8f3b-44136a626d3c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-14ec5307-9f2a-4632-8f3b-44136a626d3c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:50.857444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:50.858639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:36:50.860087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:50.867443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 421/829] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:50.868569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5307-9f2a-4632-8f3b-44136a626d3c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:50.916219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 409/830] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:50 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:36:50.924328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9261a-32af-446a-b9b4-29f120384d57 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:50.939968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:50.965412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:50.977134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5307-9f2a-4632-8f3b-44136a626d3c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:51.014647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043be0b-95f8-4190-a018-1283a557215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:51.016068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043be0b-95f8-4190-a018-1283a557215c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.016481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043be0b-95f8-4190-a018-1283a557215c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.016822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043be0b-95f8-4190-a018-1283a557215c None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.017529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043be0b-95f8-4190-a018-1283a557215c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:51.017962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043be0b-95f8-4190-a018-1283a557215c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:51.019661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043be0b-95f8-4190-a018-1283a557215c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:51.027336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 422/831] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:51.031199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043be0b-95f8-4190-a018-1283a557215c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:51.050982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9261a-32af-446a-b9b4-29f120384d57 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:51.089499 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f057b40-859c-4dd5-97c2-9409341c08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:51.090048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f057b40-859c-4dd5-97c2-9409341c08dc None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.090329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f057b40-859c-4dd5-97c2-9409341c08dc None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.090603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f057b40-859c-4dd5-97c2-9409341c08dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.101631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f057b40-859c-4dd5-97c2-9409341c08dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:51.103092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f057b40-859c-4dd5-97c2-9409341c08dc None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-3f057b40-859c-4dd5-97c2-9409341c08dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:51.119066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:51.120232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:51.121117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:51.121117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:51.121117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:51.124896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 410/832] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:51.126304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67fd97-7989-4b35-9374-7d6d2be027da None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.126589 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67fd97-7989-4b35-9374-7d6d2be027da None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.126871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67fd97-7989-4b35-9374-7d6d2be027da None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.128148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 411/833] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:51.128843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67fd97-7989-4b35-9374-7d6d2be027da None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:51.153936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043be0b-95f8-4190-a018-1283a557215c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:51.189275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1933df-1e92-40ec-a291-e4bcfe667e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:51.189874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1933df-1e92-40ec-a291-e4bcfe667e64 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.190151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1933df-1e92-40ec-a291-e4bcfe667e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.190419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1933df-1e92-40ec-a291-e4bcfe667e64 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.191038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1933df-1e92-40ec-a291-e4bcfe667e64 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:51.191359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1933df-1e92-40ec-a291-e4bcfe667e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:51.192719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1933df-1e92-40ec-a291-e4bcfe667e64 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:51.197427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 423/834] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:51.199573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534abba2-148f-4558-b944-e761c67eecc0 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.200014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534abba2-148f-4558-b944-e761c67eecc0 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.200411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534abba2-148f-4558-b944-e761c67eecc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.201586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:51.222034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-534abba2-148f-4558-b944-e761c67eecc0 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:51.223456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-534abba2-148f-4558-b944-e761c67eecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:51.240127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:51.258676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67fd97-7989-4b35-9374-7d6d2be027da None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:51.299949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4767ad-8381-45bf-ad13-234bae921de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:51.300842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4767ad-8381-45bf-ad13-234bae921de8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.301128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4767ad-8381-45bf-ad13-234bae921de8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.301402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4767ad-8381-45bf-ad13-234bae921de8 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.302058 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4767ad-8381-45bf-ad13-234bae921de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:51.302362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4767ad-8381-45bf-ad13-234bae921de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:51.303881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4767ad-8381-45bf-ad13-234bae921de8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:51.309239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 424/835] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:51.325703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 412/836] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:51.327563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534abba2-148f-4558-b944-e761c67eecc0 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:51.434165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534abba2-148f-4558-b944-e761c67eecc0 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:51.471277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21310b-b62b-4427-bed8-52e3cbb2679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:51.471941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21310b-b62b-4427-bed8-52e3cbb2679d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.472223 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21310b-b62b-4427-bed8-52e3cbb2679d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.472498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21310b-b62b-4427-bed8-52e3cbb2679d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.479759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21310b-b62b-4427-bed8-52e3cbb2679d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:51.481210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21310b-b62b-4427-bed8-52e3cbb2679d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-cc21310b-b62b-4427-bed8-52e3cbb2679d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:51.492923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:51.493805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:51.494685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:51.494685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:51.494685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:51.494685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:51.494685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:51.494685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:51.494685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:51.494685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:51.498763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 425/837] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:51.500730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4767ad-8381-45bf-ad13-234bae921de8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:51.603384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21310b-b62b-4427-bed8-52e3cbb2679d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:51.611737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4767ad-8381-45bf-ad13-234bae921de8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:51.615525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:51.627193 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:51.648677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781b5bf-fccd-45c1-9e7a-81f61e7e16ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:51.649335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781b5bf-fccd-45c1-9e7a-81f61e7e16ea None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.649620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781b5bf-fccd-45c1-9e7a-81f61e7e16ea None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.649897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781b5bf-fccd-45c1-9e7a-81f61e7e16ea None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.650594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781b5bf-fccd-45c1-9e7a-81f61e7e16ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:51.650903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781b5bf-fccd-45c1-9e7a-81f61e7e16ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:51.652386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781b5bf-fccd-45c1-9e7a-81f61e7e16ea None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:51.664868 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 413/838] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:51.673453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781b5bf-fccd-45c1-9e7a-81f61e7e16ea None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:51.730311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21310b-b62b-4427-bed8-52e3cbb2679d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:51.768938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b825-3058-44a4-9112-95971a385fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:51.769639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b825-3058-44a4-9112-95971a385fbe None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.769957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b825-3058-44a4-9112-95971a385fbe None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.770445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b825-3058-44a4-9112-95971a385fbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.781617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06b825-3058-44a4-9112-95971a385fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:51.786708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781b5bf-fccd-45c1-9e7a-81f61e7e16ea None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-cd06b825-3058-44a4-9112-95971a385fbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:51.788976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:51.789892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:51.797214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 426/839] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:36:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:51.799976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b825-3058-44a4-9112-95971a385fbe None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:51.833317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bb091-553b-4a97-824c-e1a2abb71e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:51.834384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb091-553b-4a97-824c-e1a2abb71e5d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.834970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb091-553b-4a97-824c-e1a2abb71e5d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.835484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb091-553b-4a97-824c-e1a2abb71e5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.836414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bb091-553b-4a97-824c-e1a2abb71e5d None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=7d8054e88916456991bf485c19f8b502) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:51.836934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bb091-553b-4a97-824c-e1a2abb71e5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:51.838818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bb091-553b-4a97-824c-e1a2abb71e5d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:51.845186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 414/840] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:51 2022] GET /identity/v3/role_assignments?user.id=7d8054e88916456991bf485c19f8b502&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:51.846552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3f61-c240-4079-971e-33c333a87d0e None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.846912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3f61-c240-4079-971e-33c333a87d0e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.847260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3f61-c240-4079-971e-33c333a87d0e None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.848713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 415/841] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:51.854508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413d265-bc1c-40a3-9019-8d736a1019cc None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.854805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413d265-bc1c-40a3-9019-8d736a1019cc None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.855072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413d265-bc1c-40a3-9019-8d736a1019cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.876521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f413d265-bc1c-40a3-9019-8d736a1019cc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:51.877894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f413d265-bc1c-40a3-9019-8d736a1019cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:51.883280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:51.920559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:51.922122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b825-3058-44a4-9112-95971a385fbe None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:51.963067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c9ce0-7052-4583-955d-074307dd6c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:51.964091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c9ce0-7052-4583-955d-074307dd6c68 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:51.964551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c9ce0-7052-4583-955d-074307dd6c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:51.970266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 416/842] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:36:51.970449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c9ce0-7052-4583-955d-074307dd6c68 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:51.970449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c9ce0-7052-4583-955d-074307dd6c68 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:51.970449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c9ce0-7052-4583-955d-074307dd6c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:51.970798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c9ce0-7052-4583-955d-074307dd6c68 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:51.980328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 427/843] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:36:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:51.988500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413d265-bc1c-40a3-9019-8d736a1019cc None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:52.095563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413d265-bc1c-40a3-9019-8d736a1019cc None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:52.131305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e7401-9b44-4eb6-855b-2924d338bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:52.131887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e7401-9b44-4eb6-855b-2924d338bb7d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:52.132166 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e7401-9b44-4eb6-855b-2924d338bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:52.132436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e7401-9b44-4eb6-855b-2924d338bb7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:52.142964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e7401-9b44-4eb6-855b-2924d338bb7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:52.144508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e7401-9b44-4eb6-855b-2924d338bb7d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-641e7401-9b44-4eb6-855b-2924d338bb7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:52.159893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:52.160828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:52.161725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:52.161725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:52.161725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:52.165870 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 417/844] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:52.168393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c9ce0-7052-4583-955d-074307dd6c68 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:52.252192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e7401-9b44-4eb6-855b-2924d338bb7d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:52.279461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c9ce0-7052-4583-955d-074307dd6c68 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:52.281728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:52.317162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:52.325285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86b900-136e-4e3c-b976-dde81173eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:52.326166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86b900-136e-4e3c-b976-dde81173eede None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:52.326608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86b900-136e-4e3c-b976-dde81173eede None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:52.327066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86b900-136e-4e3c-b976-dde81173eede None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:52.328817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86b900-136e-4e3c-b976-dde81173eede None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:52.329289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86b900-136e-4e3c-b976-dde81173eede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:52.330937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86b900-136e-4e3c-b976-dde81173eede None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:52.344625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 428/845] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:52.350143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86b900-136e-4e3c-b976-dde81173eede None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:52.394774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e7401-9b44-4eb6-855b-2924d338bb7d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:52.435998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf14d8-eb4c-4f81-a358-6c9860e4258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:52.436654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf14d8-eb4c-4f81-a358-6c9860e4258b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:52.436933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf14d8-eb4c-4f81-a358-6c9860e4258b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:52.437443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf14d8-eb4c-4f81-a358-6c9860e4258b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:52.448594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf14d8-eb4c-4f81-a358-6c9860e4258b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-73cf14d8-eb4c-4f81-a358-6c9860e4258b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:52.454648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:52.455607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:36:52.456426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:52.460686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 418/846] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:52.461950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf14d8-eb4c-4f81-a358-6c9860e4258b None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:52.471417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86b900-136e-4e3c-b976-dde81173eede None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:52.518046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f6568-cac3-45e8-a753-7d6eb4f54186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:52.518762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6568-cac3-45e8-a753-7d6eb4f54186 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:52.519040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6568-cac3-45e8-a753-7d6eb4f54186 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:52.519467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6568-cac3-45e8-a753-7d6eb4f54186 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:52.528131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f6568-cac3-45e8-a753-7d6eb4f54186 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:52.529686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f6568-cac3-45e8-a753-7d6eb4f54186 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-074f6568-cac3-45e8-a753-7d6eb4f54186 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:52.543001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:52.544034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:36:52.544990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:52.549579 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 429/847] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:36:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:52.550690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f6568-cac3-45e8-a753-7d6eb4f54186 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:52.564629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:52.585888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf14d8-eb4c-4f81-a358-6c9860e4258b None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:52.604458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:52.623113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c345c-ff7e-4f75-8376-257c8f09dd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:52.624116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c345c-ff7e-4f75-8376-257c8f09dd78 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:52.624667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c345c-ff7e-4f75-8376-257c8f09dd78 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:52.625176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c345c-ff7e-4f75-8376-257c8f09dd78 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:52.626046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c345c-ff7e-4f75-8376-257c8f09dd78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:52.626609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c345c-ff7e-4f75-8376-257c8f09dd78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:52.629142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c345c-ff7e-4f75-8376-257c8f09dd78 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:52.638570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 419/848] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:52.644507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c345c-ff7e-4f75-8376-257c8f09dd78 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:52.667172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f6568-cac3-45e8-a753-7d6eb4f54186 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:52.715205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9417c7a-cbc9-4b27-999b-68edb7087589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:52.716157 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9417c7a-cbc9-4b27-999b-68edb7087589 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:52.716545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9417c7a-cbc9-4b27-999b-68edb7087589 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:52.716925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9417c7a-cbc9-4b27-999b-68edb7087589 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:52.718097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9417c7a-cbc9-4b27-999b-68edb7087589 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:52.719317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9417c7a-cbc9-4b27-999b-68edb7087589 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:52.721114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9417c7a-cbc9-4b27-999b-68edb7087589 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:52.747113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 430/849] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 07:36:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:52.748756 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9417c7a-cbc9-4b27-999b-68edb7087589 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:52.773619 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c345c-ff7e-4f75-8376-257c8f09dd78 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:52.813129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17acce-37d9-4fe3-9fc2-10c1406f7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:52.814019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17acce-37d9-4fe3-9fc2-10c1406f7bed None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:52.814432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17acce-37d9-4fe3-9fc2-10c1406f7bed None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:52.814958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17acce-37d9-4fe3-9fc2-10c1406f7bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:52.827005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17acce-37d9-4fe3-9fc2-10c1406f7bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:52.828620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17acce-37d9-4fe3-9fc2-10c1406f7bed None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:52.830642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-1f17acce-37d9-4fe3-9fc2-10c1406f7bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:52.845941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:52.852753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:52.853654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:52.853654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:52.853654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:52.853654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 420/850] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:52.853654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17acce-37d9-4fe3-9fc2-10c1406f7bed None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:52.877225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9417c7a-cbc9-4b27-999b-68edb7087589 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:52.887962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:52.915712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ac06a-147a-44d6-ba04-67cf00b79c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:52.916465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ac06a-147a-44d6-ba04-67cf00b79c95 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:52.916975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ac06a-147a-44d6-ba04-67cf00b79c95 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:52.917322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ac06a-147a-44d6-ba04-67cf00b79c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:52.969766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17acce-37d9-4fe3-9fc2-10c1406f7bed None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:53.005652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ac06a-147a-44d6-ba04-67cf00b79c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.008476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ac06a-147a-44d6-ba04-67cf00b79c95 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.027513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1ba81-13df-484f-8317-1a835ea37405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:53.028863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1ba81-13df-484f-8317-1a835ea37405 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.029704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1ba81-13df-484f-8317-1a835ea37405 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.030530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1ba81-13df-484f-8317-1a835ea37405 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.032015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1ba81-13df-484f-8317-1a835ea37405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:53.032902 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1ba81-13df-484f-8317-1a835ea37405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.035771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1ba81-13df-484f-8317-1a835ea37405 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.059366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 421/851] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:53.065391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1ba81-13df-484f-8317-1a835ea37405 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:53.142471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:53.170417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 431/852] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:52 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:36:53.172228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ac06a-147a-44d6-ba04-67cf00b79c95 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:53.184049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:53.195984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1ba81-13df-484f-8317-1a835ea37405 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:53.233306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144702c0-993e-48e9-ada5-c5d43d850ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:53.234453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144702c0-993e-48e9-ada5-c5d43d850ec7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.234838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144702c0-993e-48e9-ada5-c5d43d850ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.234981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144702c0-993e-48e9-ada5-c5d43d850ec7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.242611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144702c0-993e-48e9-ada5-c5d43d850ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.244071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144702c0-993e-48e9-ada5-c5d43d850ec7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-144702c0-993e-48e9-ada5-c5d43d850ec7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:53.255955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:53.256918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:53.257837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 422/853] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:36:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:53.258919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b57b3-a3f3-4e0d-a182-eb11c5eaf74c None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.258919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b57b3-a3f3-4e0d-a182-eb11c5eaf74c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.258919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b57b3-a3f3-4e0d-a182-eb11c5eaf74c None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.260145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 423/854] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:53.264716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b57b3-a3f3-4e0d-a182-eb11c5eaf74c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:53.280096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ac06a-147a-44d6-ba04-67cf00b79c95 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:53.315986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113e6b9-8bee-488b-980a-81764e3a16c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:53.316607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113e6b9-8bee-488b-980a-81764e3a16c1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.316882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113e6b9-8bee-488b-980a-81764e3a16c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.317159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113e6b9-8bee-488b-980a-81764e3a16c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.327140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113e6b9-8bee-488b-980a-81764e3a16c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.329362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113e6b9-8bee-488b-980a-81764e3a16c1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-c113e6b9-8bee-488b-980a-81764e3a16c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:53.345772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:53.346752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:53.348251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:53.348251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:53.348251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:53.348251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 432/855] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:53.348473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973446f8-bd2e-4790-9354-8583681727b8 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.348730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973446f8-bd2e-4790-9354-8583681727b8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.348903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973446f8-bd2e-4790-9354-8583681727b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.369097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-973446f8-bd2e-4790-9354-8583681727b8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:53.370273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-973446f8-bd2e-4790-9354-8583681727b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:53.384739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b57b3-a3f3-4e0d-a182-eb11c5eaf74c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:53.400358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:53.422061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3b40f-a61f-4620-bc35-b19cccccd384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:53.423070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3b40f-a61f-4620-bc35-b19cccccd384 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.423543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3b40f-a61f-4620-bc35-b19cccccd384 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.423653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3b40f-a61f-4620-bc35-b19cccccd384 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.424370 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3b40f-a61f-4620-bc35-b19cccccd384 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:53.428585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3b40f-a61f-4620-bc35-b19cccccd384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.428585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3b40f-a61f-4620-bc35-b19cccccd384 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.429268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:53.451510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 433/856] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:53.451510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973446f8-bd2e-4790-9354-8583681727b8 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:53.456177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 424/857] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 24 07:36:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:53.461691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3b40f-a61f-4620-bc35-b19cccccd384 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:53.576845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973446f8-bd2e-4790-9354-8583681727b8 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:53.578488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3b40f-a61f-4620-bc35-b19cccccd384 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:53.617305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f97ca-a637-4710-b359-027194b17da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:53.618046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f97ca-a637-4710-b359-027194b17da0 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.618434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f97ca-a637-4710-b359-027194b17da0 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.618808 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f97ca-a637-4710-b359-027194b17da0 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.619662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f97ca-a637-4710-b359-027194b17da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:53.620067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f97ca-a637-4710-b359-027194b17da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.621552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f97ca-a637-4710-b359-027194b17da0 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.623156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104a602-d579-4ce3-a234-4d0c9b476da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:53.623877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104a602-d579-4ce3-a234-4d0c9b476da9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.624792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104a602-d579-4ce3-a234-4d0c9b476da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.625137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104a602-d579-4ce3-a234-4d0c9b476da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.638255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 434/858] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:53.639240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f97ca-a637-4710-b359-027194b17da0 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:53.680683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:53.704197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:53.709250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104a602-d579-4ce3-a234-4d0c9b476da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.710783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104a602-d579-4ce3-a234-4d0c9b476da9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.760183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f97ca-a637-4710-b359-027194b17da0 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:53.799947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604540-08cd-454d-8bdf-8ab2b18443ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:53.800830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604540-08cd-454d-8bdf-8ab2b18443ba None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.801120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604540-08cd-454d-8bdf-8ab2b18443ba None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.801391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604540-08cd-454d-8bdf-8ab2b18443ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.808129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da604540-08cd-454d-8bdf-8ab2b18443ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.809582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da604540-08cd-454d-8bdf-8ab2b18443ba None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.824811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 425/859] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:53 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-da604540-08cd-454d-8bdf-8ab2b18443ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:53.825305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:53.826305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:53.827355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:53.827355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:53.827355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:53.827355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:53.827355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:53.827355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:53.827355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:53.827355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:53.829759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104a602-d579-4ce3-a234-4d0c9b476da9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:53.829845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 435/860] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:53.829845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604540-08cd-454d-8bdf-8ab2b18443ba None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:53.906983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:53.935629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604540-08cd-454d-8bdf-8ab2b18443ba None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:53.938765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104a602-d579-4ce3-a234-4d0c9b476da9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:53.947241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:53.970804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fd789-56b0-42b3-8334-dac24e7c0326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:53.971468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fd789-56b0-42b3-8334-dac24e7c0326 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.971757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fd789-56b0-42b3-8334-dac24e7c0326 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.972042 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fd789-56b0-42b3-8334-dac24e7c0326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.972649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bc8fe-df5f-4677-96e4-4557fdd78aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:53.973245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bc8fe-df5f-4677-96e4-4557fdd78aef None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:53.973518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bc8fe-df5f-4677-96e4-4557fdd78aef None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:53.973794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bc8fe-df5f-4677-96e4-4557fdd78aef None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:53.974425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bc8fe-df5f-4677-96e4-4557fdd78aef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.975846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bc8fe-df5f-4677-96e4-4557fdd78aef None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.982892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fd789-56b0-42b3-8334-dac24e7c0326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:53.985020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fd789-56b0-42b3-8334-dac24e7c0326 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-744fd789-56b0-42b3-8334-dac24e7c0326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:53.998646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:54.001200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:54.002232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:54.002232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:54.002232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:54.002232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 436/861] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:54.002232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fd789-56b0-42b3-8334-dac24e7c0326 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:54.057230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 426/862] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:36:53 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:54.058452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ea9df-7d7e-4579-b067-5091fc4e01aa None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.058734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ea9df-7d7e-4579-b067-5091fc4e01aa None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.059000 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ea9df-7d7e-4579-b067-5091fc4e01aa None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.060479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 427/863] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:54.061210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ea9df-7d7e-4579-b067-5091fc4e01aa None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:54.120210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fd789-56b0-42b3-8334-dac24e7c0326 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:54.165339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4037f9-6004-40df-93cc-9c6a6d353027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:54.165970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4037f9-6004-40df-93cc-9c6a6d353027 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.166253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4037f9-6004-40df-93cc-9c6a6d353027 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.166537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4037f9-6004-40df-93cc-9c6a6d353027 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.167247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4037f9-6004-40df-93cc-9c6a6d353027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:54.167605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4037f9-6004-40df-93cc-9c6a6d353027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:54.169097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4037f9-6004-40df-93cc-9c6a6d353027 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:54.183146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 437/864] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:54.184450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca200e3b-53e9-4cc3-bf82-f747b29428e3 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.184741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca200e3b-53e9-4cc3-bf82-f747b29428e3 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.185020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca200e3b-53e9-4cc3-bf82-f747b29428e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.195494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ea9df-7d7e-4579-b067-5091fc4e01aa None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:54.203931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ca200e3b-53e9-4cc3-bf82-f747b29428e3 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:54.205135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ca200e3b-53e9-4cc3-bf82-f747b29428e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:54.220847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:54.230765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:54.236432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8148f1-0675-41c7-92a1-8257793fef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:54.237046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8148f1-0675-41c7-92a1-8257793fef08 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.239443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8148f1-0675-41c7-92a1-8257793fef08 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.239443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8148f1-0675-41c7-92a1-8257793fef08 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.239443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8148f1-0675-41c7-92a1-8257793fef08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:54.239443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8148f1-0675-41c7-92a1-8257793fef08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:54.239982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8148f1-0675-41c7-92a1-8257793fef08 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:54.252231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 428/865] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:54.253448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8148f1-0675-41c7-92a1-8257793fef08 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:54.281259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 438/866] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:54 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:54.282214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca200e3b-53e9-4cc3-bf82-f747b29428e3 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:54.382003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8148f1-0675-41c7-92a1-8257793fef08 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:54.400781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca200e3b-53e9-4cc3-bf82-f747b29428e3 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:54.418182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8857-b98f-416f-8e1d-15839e3569a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:54.418841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8857-b98f-416f-8e1d-15839e3569a6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.419127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8857-b98f-416f-8e1d-15839e3569a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.419430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8857-b98f-416f-8e1d-15839e3569a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.420152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b8857-b98f-416f-8e1d-15839e3569a6 None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=79129c52456e4455bce3179d1e056fb0) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:54.420458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b8857-b98f-416f-8e1d-15839e3569a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:54.422505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b8857-b98f-416f-8e1d-15839e3569a6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:54.429319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 429/867] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:54 2022] GET /identity/v3/role_assignments?user.id=79129c52456e4455bce3179d1e056fb0&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:54.454359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c05a5-85da-4c70-81df-8b51e34f405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:54.454992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c05a5-85da-4c70-81df-8b51e34f405a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.455274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c05a5-85da-4c70-81df-8b51e34f405a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.455580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c05a5-85da-4c70-81df-8b51e34f405a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.463723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c05a5-85da-4c70-81df-8b51e34f405a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:54.465279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c05a5-85da-4c70-81df-8b51e34f405a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-204c05a5-85da-4c70-81df-8b51e34f405a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:54.478550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:54.479535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:54.480421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:54.480421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:54.480421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:54.480421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:54.480421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:54.480421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:54.480421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:54.480421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:54.480421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 439/868] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:54.488366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8857-b98f-416f-8e1d-15839e3569a6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:54.555373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:54.557497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c05a5-85da-4c70-81df-8b51e34f405a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:54.570310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:54.616330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8857-b98f-416f-8e1d-15839e3569a6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:54.661742 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a5e44-1f53-4330-a96c-9512511a9172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:54.662598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a5e44-1f53-4330-a96c-9512511a9172 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.663033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a5e44-1f53-4330-a96c-9512511a9172 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.663340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a5e44-1f53-4330-a96c-9512511a9172 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.664032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a5e44-1f53-4330-a96c-9512511a9172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:54.664343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a5e44-1f53-4330-a96c-9512511a9172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:54.665771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a5e44-1f53-4330-a96c-9512511a9172 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:54.681187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 430/869] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:54.681560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c05a5-85da-4c70-81df-8b51e34f405a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:54.687486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a5e44-1f53-4330-a96c-9512511a9172 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:54.727851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412615-f06d-4498-8c23-9eae117fb004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:54.728411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412615-f06d-4498-8c23-9eae117fb004 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.728709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412615-f06d-4498-8c23-9eae117fb004 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.728985 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412615-f06d-4498-8c23-9eae117fb004 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.729575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412615-f06d-4498-8c23-9eae117fb004 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:54.730954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412615-f06d-4498-8c23-9eae117fb004 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-65412615-f06d-4498-8c23-9eae117fb004 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:54.740766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:54.741724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:54.743011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 440/870] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 24 07:36:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:54.747856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412615-f06d-4498-8c23-9eae117fb004 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:54.821448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a5e44-1f53-4330-a96c-9512511a9172 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:54.829910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:54.844807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:54.864604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412615-f06d-4498-8c23-9eae117fb004 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:54.870625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ff48f-d99e-4d11-924c-5086e2f35903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:54.871489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff48f-d99e-4d11-924c-5086e2f35903 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.872577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff48f-d99e-4d11-924c-5086e2f35903 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.873117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff48f-d99e-4d11-924c-5086e2f35903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.874076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ff48f-d99e-4d11-924c-5086e2f35903 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=15d9847a3a5048efb19e507f988e37f4) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:54.875080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ff48f-d99e-4d11-924c-5086e2f35903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:54.877476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ff48f-d99e-4d11-924c-5086e2f35903 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:54.886559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 431/871] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:54 2022] GET /identity/v3/role_assignments?user.id=15d9847a3a5048efb19e507f988e37f4&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:54.909573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e4635-5595-4df8-9f57-a8ce9cffe050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:54.910306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e4635-5595-4df8-9f57-a8ce9cffe050 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:54.910662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e4635-5595-4df8-9f57-a8ce9cffe050 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:54.911012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e4635-5595-4df8-9f57-a8ce9cffe050 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:54.911839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e4635-5595-4df8-9f57-a8ce9cffe050 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:54.912221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e4635-5595-4df8-9f57-a8ce9cffe050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:54.913905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e4635-5595-4df8-9f57-a8ce9cffe050 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:54.920236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 441/872] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:36:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:54.927222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ff48f-d99e-4d11-924c-5086e2f35903 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:55.048997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ff48f-d99e-4d11-924c-5086e2f35903 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:55.087761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00777842-b5cd-4f17-843c-f7a9f663fa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:55.088700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00777842-b5cd-4f17-843c-f7a9f663fa97 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:55.089120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00777842-b5cd-4f17-843c-f7a9f663fa97 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:55.089530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00777842-b5cd-4f17-843c-f7a9f663fa97 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:55.090300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00777842-b5cd-4f17-843c-f7a9f663fa97 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:55.090764 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00777842-b5cd-4f17-843c-f7a9f663fa97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:55.092316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00777842-b5cd-4f17-843c-f7a9f663fa97 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:55.099160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 432/873] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:36:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:56.101196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7568bb-c74a-4743-9a78-82a7c344360d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:56.102210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7568bb-c74a-4743-9a78-82a7c344360d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:56.102795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7568bb-c74a-4743-9a78-82a7c344360d None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:56.104384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 442/874] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:36:56.110605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db4427-97ce-4d70-861e-2012b95758c1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:56.111477 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db4427-97ce-4d70-861e-2012b95758c1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:56.111950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db4427-97ce-4d70-861e-2012b95758c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:56.130300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-62db4427-97ce-4d70-861e-2012b95758c1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:56.131852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-62db4427-97ce-4d70-861e-2012b95758c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:56.178509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:56.208166 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 433/875] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:56.493095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7568bb-c74a-4743-9a78-82a7c344360d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:56.534177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25de41-dfc2-4dba-9dcd-8ecc619735ac None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:56.534499 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25de41-dfc2-4dba-9dcd-8ecc619735ac None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:56.534741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25de41-dfc2-4dba-9dcd-8ecc619735ac None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:56.537244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 434/876] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:36:56.542862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6447c82-771c-45f0-af0e-747320d6ccda None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:56.543153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6447c82-771c-45f0-af0e-747320d6ccda None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:56.543463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6447c82-771c-45f0-af0e-747320d6ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:56.567394 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e6447c82-771c-45f0-af0e-747320d6ccda None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:56.568603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e6447c82-771c-45f0-af0e-747320d6ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:56.607605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7568bb-c74a-4743-9a78-82a7c344360d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:56.649195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 435/877] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:36:56.663343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84624a9-3727-4b6a-8a1a-e68d8e9ebddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:56.663343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84624a9-3727-4b6a-8a1a-e68d8e9ebddb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:56.663343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84624a9-3727-4b6a-8a1a-e68d8e9ebddb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:56.663343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84624a9-3727-4b6a-8a1a-e68d8e9ebddb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:56.663725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84624a9-3727-4b6a-8a1a-e68d8e9ebddb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:56.663725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84624a9-3727-4b6a-8a1a-e68d8e9ebddb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:56.666351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-f84624a9-3727-4b6a-8a1a-e68d8e9ebddb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:56.673695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:56.685943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:56.687340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 443/878] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:56.688279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6447c82-771c-45f0-af0e-747320d6ccda None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:56.789469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6447c82-771c-45f0-af0e-747320d6ccda None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:56.799646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:56.838218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4729ac5-1a30-44fd-8b15-7db293e6a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:56.838894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4729ac5-1a30-44fd-8b15-7db293e6a79d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:56.839179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4729ac5-1a30-44fd-8b15-7db293e6a79d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:56.839494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4729ac5-1a30-44fd-8b15-7db293e6a79d None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:56.840432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4729ac5-1a30-44fd-8b15-7db293e6a79d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:56.840737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4729ac5-1a30-44fd-8b15-7db293e6a79d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:56.842101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4729ac5-1a30-44fd-8b15-7db293e6a79d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:56.847666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 436/879] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:56.853328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84624a9-3727-4b6a-8a1a-e68d8e9ebddb None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:56.906477 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b486e4-f98e-410e-ab1a-ff1853e18720 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:56.907076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b486e4-f98e-410e-ab1a-ff1853e18720 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:56.907592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b486e4-f98e-410e-ab1a-ff1853e18720 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:56.909403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 437/880] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:56.914296 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fba48-2aaa-4945-833a-f50108fd364c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:56.914575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fba48-2aaa-4945-833a-f50108fd364c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:56.914849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fba48-2aaa-4945-833a-f50108fd364c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:56.935328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-247fba48-2aaa-4945-833a-f50108fd364c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:56.937444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-247fba48-2aaa-4945-833a-f50108fd364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:56.977061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84624a9-3727-4b6a-8a1a-e68d8e9ebddb None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.009192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 438/881] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:36:57.026322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fba48-2aaa-4945-833a-f50108fd364c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.026534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12b58-0648-4945-9870-0efbfc661150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.026534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12b58-0648-4945-9870-0efbfc661150 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.026534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12b58-0648-4945-9870-0efbfc661150 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.026534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12b58-0648-4945-9870-0efbfc661150 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.026797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa12b58-0648-4945-9870-0efbfc661150 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:57.026797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa12b58-0648-4945-9870-0efbfc661150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:57.026797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa12b58-0648-4945-9870-0efbfc661150 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:57.036293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 444/882] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:57.041523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12b58-0648-4945-9870-0efbfc661150 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.119564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:57.126913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:57.130370 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fba48-2aaa-4945-833a-f50108fd364c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.158017 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12b58-0648-4945-9870-0efbfc661150 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.164200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1d2e1-49f5-4f4f-93cf-c544971ea413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.164835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1d2e1-49f5-4f4f-93cf-c544971ea413 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.165123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1d2e1-49f5-4f4f-93cf-c544971ea413 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.165398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1d2e1-49f5-4f4f-93cf-c544971ea413 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.176769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1d2e1-49f5-4f4f-93cf-c544971ea413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-fce1d2e1-49f5-4f4f-93cf-c544971ea413 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:36:57.182505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:57.183470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:57.184290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 439/883] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:57.184980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d7454-27bd-44e5-b57e-735a66ed8b2a None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.185047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d7454-27bd-44e5-b57e-735a66ed8b2a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.185896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d7454-27bd-44e5-b57e-735a66ed8b2a None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.191455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 440/884] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:57.191455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d7454-27bd-44e5-b57e-735a66ed8b2a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.203010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afe25d-20d7-408f-bd8d-9d6e95658267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.203553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe25d-20d7-408f-bd8d-9d6e95658267 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.203834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe25d-20d7-408f-bd8d-9d6e95658267 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.204133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe25d-20d7-408f-bd8d-9d6e95658267 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.204979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afe25d-20d7-408f-bd8d-9d6e95658267 None admin] RBAC: Adding query filter params (interface=public, service_id=81976745e69c43bf9daa5578a5b2825a, region_id=RegionOne) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:57.205284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afe25d-20d7-408f-bd8d-9d6e95658267 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:57.206862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afe25d-20d7-408f-bd8d-9d6e95658267 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:57.216466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 445/885] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/endpoints?service_id=81976745e69c43bf9daa5578a5b2825a&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:57.217683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33526-bb71-4b32-a58c-9b44fb1c0ab2 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.218526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33526-bb71-4b32-a58c-9b44fb1c0ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.218800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33526-bb71-4b32-a58c-9b44fb1c0ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.236444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a4c33526-bb71-4b32-a58c-9b44fb1c0ab2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:57.237611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a4c33526-bb71-4b32-a58c-9b44fb1c0ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:57.301192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d7454-27bd-44e5-b57e-735a66ed8b2a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.308187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 446/886] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:57 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:57.309074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33526-bb71-4b32-a58c-9b44fb1c0ab2 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.335879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06a4a-85c4-411d-bfcb-75c0acb6ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.336565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06a4a-85c4-411d-bfcb-75c0acb6ce86 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.336838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06a4a-85c4-411d-bfcb-75c0acb6ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.337108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06a4a-85c4-411d-bfcb-75c0acb6ce86 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.337766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06a4a-85c4-411d-bfcb-75c0acb6ce86 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:57.338063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06a4a-85c4-411d-bfcb-75c0acb6ce86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:57.339443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06a4a-85c4-411d-bfcb-75c0acb6ce86 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:57.348131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 441/887] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:57.348924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06a4a-85c4-411d-bfcb-75c0acb6ce86 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.373958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:57.395429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:57.441109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33526-bb71-4b32-a58c-9b44fb1c0ab2 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.457541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06a4a-85c4-411d-bfcb-75c0acb6ce86 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.477072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11655-10c4-4e14-808e-babbb0580c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.477676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11655-10c4-4e14-808e-babbb0580c70 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.477963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11655-10c4-4e14-808e-babbb0580c70 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.478239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11655-10c4-4e14-808e-babbb0580c70 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.478836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d11655-10c4-4e14-808e-babbb0580c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:57.480274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d11655-10c4-4e14-808e-babbb0580c70 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:57.485998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 447/888] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/services => generated 1011 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:36:57.486902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11655-10c4-4e14-808e-babbb0580c70 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.507857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb425-47a8-4556-9738-5330f1a78cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.509400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb425-47a8-4556-9738-5330f1a78cf0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.510002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb425-47a8-4556-9738-5330f1a78cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.510481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb425-47a8-4556-9738-5330f1a78cf0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.512023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb425-47a8-4556-9738-5330f1a78cf0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:57.514122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb425-47a8-4556-9738-5330f1a78cf0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-ee0eb425-47a8-4556-9738-5330f1a78cf0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:57.531824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:57.532886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:36:57.533711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:57.537415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 442/889] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:57.545471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb425-47a8-4556-9738-5330f1a78cf0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.623775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11655-10c4-4e14-808e-babbb0580c70 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.651095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:57.656763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:57.668855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c2c1c-b5d3-4422-b5ee-fd73269977d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.669035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb425-47a8-4556-9738-5330f1a78cf0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.669488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c2c1c-b5d3-4422-b5ee-fd73269977d4 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.669770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c2c1c-b5d3-4422-b5ee-fd73269977d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.670038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c2c1c-b5d3-4422-b5ee-fd73269977d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.681374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c2c1c-b5d3-4422-b5ee-fd73269977d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:57.682820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c2c1c-b5d3-4422-b5ee-fd73269977d4 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-928c2c1c-b5d3-4422-b5ee-fd73269977d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:57.698650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:57.699655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:57.700533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:57.700533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:57.700533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:57.700533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 448/890] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:57.701457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c2c1c-b5d3-4422-b5ee-fd73269977d4 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.713053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d24ca-6cfa-4078-a99e-0b6a0618a1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.713660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d24ca-6cfa-4078-a99e-0b6a0618a1a9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.713936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d24ca-6cfa-4078-a99e-0b6a0618a1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.714208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d24ca-6cfa-4078-a99e-0b6a0618a1a9 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.715053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d24ca-6cfa-4078-a99e-0b6a0618a1a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:57.715157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d24ca-6cfa-4078-a99e-0b6a0618a1a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:57.716496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d24ca-6cfa-4078-a99e-0b6a0618a1a9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:57.721351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 443/891] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:36:57.726741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d24ca-6cfa-4078-a99e-0b6a0618a1a9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.811854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c2c1c-b5d3-4422-b5ee-fd73269977d4 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.833497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d24ca-6cfa-4078-a99e-0b6a0618a1a9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:57.850216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a7091-8751-4b65-bb04-8a37b07aa33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.850826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a7091-8751-4b65-bb04-8a37b07aa33a None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.851108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a7091-8751-4b65-bb04-8a37b07aa33a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.851415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a7091-8751-4b65-bb04-8a37b07aa33a None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.852054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a7091-8751-4b65-bb04-8a37b07aa33a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:57.853435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a7091-8751-4b65-bb04-8a37b07aa33a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:57.868595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120db95a-d518-4aed-b51a-368dc61f4dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:57.869190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120db95a-d518-4aed-b51a-368dc61f4dda None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:57.869465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120db95a-d518-4aed-b51a-368dc61f4dda None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:57.869730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120db95a-d518-4aed-b51a-368dc61f4dda None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:57.870353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120db95a-d518-4aed-b51a-368dc61f4dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:57.870643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120db95a-d518-4aed-b51a-368dc61f4dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:57.872057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120db95a-d518-4aed-b51a-368dc61f4dda None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:57.883894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 444/892] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:57.884680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120db95a-d518-4aed-b51a-368dc61f4dda None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.898006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:57.949607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 449/893] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:36:57 2022] POST /identity/v3/services => generated 269 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:36:57.949957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a7091-8751-4b65-bb04-8a37b07aa33a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:57.994393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:58.012698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120db95a-d518-4aed-b51a-368dc61f4dda None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:58.069027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5d7ea-3f12-48a0-ac38-8499252f99b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:58.070557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5d7ea-3f12-48a0-ac38-8499252f99b1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:58.071170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5d7ea-3f12-48a0-ac38-8499252f99b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:58.071667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5d7ea-3f12-48a0-ac38-8499252f99b1 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:58.072674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5d7ea-3f12-48a0-ac38-8499252f99b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:58.073557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5d7ea-3f12-48a0-ac38-8499252f99b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:58.075611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5d7ea-3f12-48a0-ac38-8499252f99b1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:58.079999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a7091-8751-4b65-bb04-8a37b07aa33a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:58.083415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 445/894] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:58.128293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770976e-9e08-494e-b7b0-fe9e5bb5072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:58.128992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770976e-9e08-494e-b7b0-fe9e5bb5072f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:58.129222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770976e-9e08-494e-b7b0-fe9e5bb5072f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:58.129495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770976e-9e08-494e-b7b0-fe9e5bb5072f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:58.138642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770976e-9e08-494e-b7b0-fe9e5bb5072f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:58.140952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770976e-9e08-494e-b7b0-fe9e5bb5072f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-f770976e-9e08-494e-b7b0-fe9e5bb5072f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:36:58.153854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:58.154875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:36:58.156596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 450/895] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:36:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:58.161671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5d7ea-3f12-48a0-ac38-8499252f99b1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:58.240929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:58.275141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5d7ea-3f12-48a0-ac38-8499252f99b1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:58.310302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987287-be37-4b37-98da-412b59aa49db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:58.311086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987287-be37-4b37-98da-412b59aa49db None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:58.311395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987287-be37-4b37-98da-412b59aa49db None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:58.311860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987287-be37-4b37-98da-412b59aa49db None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:58.312713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987287-be37-4b37-98da-412b59aa49db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:58.313028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987287-be37-4b37-98da-412b59aa49db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:58.314451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987287-be37-4b37-98da-412b59aa49db None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:58.334053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 446/896] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 07:36:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:58.339642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770976e-9e08-494e-b7b0-fe9e5bb5072f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:58.444881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:58.451633 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770976e-9e08-494e-b7b0-fe9e5bb5072f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:58.487541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590732f2-f45f-4065-bb26-2da7058f0fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:58.488152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590732f2-f45f-4065-bb26-2da7058f0fb9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:58.488436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590732f2-f45f-4065-bb26-2da7058f0fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:58.488714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590732f2-f45f-4065-bb26-2da7058f0fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:58.560722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590732f2-f45f-4065-bb26-2da7058f0fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:58.562483 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590732f2-f45f-4065-bb26-2da7058f0fb9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:58.659946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:58.666774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 451/897] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:36:58 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:36:58.673504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987287-be37-4b37-98da-412b59aa49db None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:58.775865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987287-be37-4b37-98da-412b59aa49db None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:58.803133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:58.812277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449752a4-e248-4f3f-b225-ddaeb9f2c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:58.812839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449752a4-e248-4f3f-b225-ddaeb9f2c6cf None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:58.813114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449752a4-e248-4f3f-b225-ddaeb9f2c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:58.813381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449752a4-e248-4f3f-b225-ddaeb9f2c6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:58.823749 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449752a4-e248-4f3f-b225-ddaeb9f2c6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:58.825176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449752a4-e248-4f3f-b225-ddaeb9f2c6cf None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-449752a4-e248-4f3f-b225-ddaeb9f2c6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:36:58.839750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:58.840770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:36:58.841968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:36:58.841968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:36:58.841968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:58.841968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 447/898] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:36:58.847329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590732f2-f45f-4065-bb26-2da7058f0fb9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:58.955226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590732f2-f45f-4065-bb26-2da7058f0fb9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:58.990951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34459a-73b9-4a8a-b2ef-d9c8a3fdb44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:58.991637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34459a-73b9-4a8a-b2ef-d9c8a3fdb44b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:58.991927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34459a-73b9-4a8a-b2ef-d9c8a3fdb44b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:58.992340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34459a-73b9-4a8a-b2ef-d9c8a3fdb44b None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:58.992987 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34459a-73b9-4a8a-b2ef-d9c8a3fdb44b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:58.993290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34459a-73b9-4a8a-b2ef-d9c8a3fdb44b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:58.994665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34459a-73b9-4a8a-b2ef-d9c8a3fdb44b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:59.011574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 452/899] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:59.012942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449752a4-e248-4f3f-b225-ddaeb9f2c6cf None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:59.126453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449752a4-e248-4f3f-b225-ddaeb9f2c6cf None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:59.162021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764494d0-1aa3-4c8d-968e-277b2b8b8dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:59.162636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764494d0-1aa3-4c8d-968e-277b2b8b8dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:59.162903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764494d0-1aa3-4c8d-968e-277b2b8b8dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:59.163172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764494d0-1aa3-4c8d-968e-277b2b8b8dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:59.169962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764494d0-1aa3-4c8d-968e-277b2b8b8dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:59.172245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764494d0-1aa3-4c8d-968e-277b2b8b8dd6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-764494d0-1aa3-4c8d-968e-277b2b8b8dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:36:59.184008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:36:59.184923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:36:59.185817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:36:59.185817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:36:59.185817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:36:59.185817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:36:59.185817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:36:59.185817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:36:59.185817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:36:59.185817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:36:59.185817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 448/900] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:36:59.192816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34459a-73b9-4a8a-b2ef-d9c8a3fdb44b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:59.251894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:59.300656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34459a-73b9-4a8a-b2ef-d9c8a3fdb44b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:59.335119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df691e69-267d-45d2-8b5b-c1f60a8f3cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:59.336073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691e69-267d-45d2-8b5b-c1f60a8f3cfc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:59.336548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691e69-267d-45d2-8b5b-c1f60a8f3cfc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:59.337041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691e69-267d-45d2-8b5b-c1f60a8f3cfc None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:59.337933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df691e69-267d-45d2-8b5b-c1f60a8f3cfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:59.338432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df691e69-267d-45d2-8b5b-c1f60a8f3cfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:59.340108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df691e69-267d-45d2-8b5b-c1f60a8f3cfc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:59.353329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 453/901] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:59.360427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764494d0-1aa3-4c8d-968e-277b2b8b8dd6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:36:59.410227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:36:59.478976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764494d0-1aa3-4c8d-968e-277b2b8b8dd6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:36:59.515395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42202f9-4018-471e-8d62-1db4fe9434d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:36:59.515998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42202f9-4018-471e-8d62-1db4fe9434d3 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:59.516275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42202f9-4018-471e-8d62-1db4fe9434d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:59.516543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42202f9-4018-471e-8d62-1db4fe9434d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:59.517255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42202f9-4018-471e-8d62-1db4fe9434d3 None admin] RBAC: Adding query filter params (role.id=692f6347c3684ae090a246e0ed558ef1, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=79129c52456e4455bce3179d1e056fb0) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:36:59.517554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42202f9-4018-471e-8d62-1db4fe9434d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:36:59.519139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42202f9-4018-471e-8d62-1db4fe9434d3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:36:59.525097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 449/902] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:36:59 2022] GET /identity/v3/role_assignments?user.id=79129c52456e4455bce3179d1e056fb0&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=692f6347c3684ae090a246e0ed558ef1 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:36:59.565225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ca49-9db6-44a0-b3f3-f6a16d83a8ea None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:59.565504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ca49-9db6-44a0-b3f3-f6a16d83a8ea None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:59.565778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34ca49-9db6-44a0-b3f3-f6a16d83a8ea None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:59.567505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 454/903] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:36:59.573424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464b7d-12f7-4e11-ab5e-36833164d0d0 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:36:59.573763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464b7d-12f7-4e11-ab5e-36833164d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:36:59.573983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464b7d-12f7-4e11-ab5e-36833164d0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:36:59.595543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8c464b7d-12f7-4e11-ab5e-36833164d0d0 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:36:59.596752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8c464b7d-12f7-4e11-ab5e-36833164d0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:36:59.672592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 450/904] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:36:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:36:59.945990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34ca49-9db6-44a0-b3f3-f6a16d83a8ea None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:00.017482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d344010-c27e-4a31-b5da-38dc23cd690f None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.017811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d344010-c27e-4a31-b5da-38dc23cd690f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.018030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d344010-c27e-4a31-b5da-38dc23cd690f None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.019651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 451/905] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:00.025038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20dd81-1b37-4345-a0dc-f064dda2d7bd None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.025323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20dd81-1b37-4345-a0dc-f064dda2d7bd None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.025597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20dd81-1b37-4345-a0dc-f064dda2d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.044531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-0f20dd81-1b37-4345-a0dc-f064dda2d7bd None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:00.046352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0f20dd81-1b37-4345-a0dc-f064dda2d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:00.060374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34ca49-9db6-44a0-b3f3-f6a16d83a8ea None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:00.075788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:00.078378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:00.104378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e29b-f6e5-49e0-8375-329a0652680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:00.105007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e29b-f6e5-49e0-8375-329a0652680f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.105282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e29b-f6e5-49e0-8375-329a0652680f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.105555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e29b-f6e5-49e0-8375-329a0652680f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.106133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691e29b-f6e5-49e0-8375-329a0652680f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:00.107588 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691e29b-f6e5-49e0-8375-329a0652680f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-e691e29b-f6e5-49e0-8375-329a0652680f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:00.117239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:00.118194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:00.119124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 455/906] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:36:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:00.125142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e29b-f6e5-49e0-8375-329a0652680f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:00.140280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 452/907] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:00.142708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67954846-ce6d-4196-bae8-d1d5768f870d None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.142983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67954846-ce6d-4196-bae8-d1d5768f870d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.143263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67954846-ce6d-4196-bae8-d1d5768f870d None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.144842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 453/908] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:00.149706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ada5de-7e11-442e-a6dd-f04a3772381a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.150009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ada5de-7e11-442e-a6dd-f04a3772381a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.150292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ada5de-7e11-442e-a6dd-f04a3772381a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.172333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e5ada5de-7e11-442e-a6dd-f04a3772381a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:00.174312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e5ada5de-7e11-442e-a6dd-f04a3772381a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:00.235435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e29b-f6e5-49e0-8375-329a0652680f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:00.244611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 454/909] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:00.276386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf538527-a3ce-45eb-b670-69da9f39dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:00.277369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf538527-a3ce-45eb-b670-69da9f39dda4 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.277869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf538527-a3ce-45eb-b670-69da9f39dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.278348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf538527-a3ce-45eb-b670-69da9f39dda4 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.279156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf538527-a3ce-45eb-b670-69da9f39dda4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:00.279681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf538527-a3ce-45eb-b670-69da9f39dda4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:00.282098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf538527-a3ce-45eb-b670-69da9f39dda4 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:00.287413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 456/910] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:37:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:00.299507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ada5de-7e11-442e-a6dd-f04a3772381a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:00.393246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:00.401943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ada5de-7e11-442e-a6dd-f04a3772381a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:00.405806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf538527-a3ce-45eb-b670-69da9f39dda4 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:00.442589 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb76fd-cb27-4baf-a409-bae40d38b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:00.443313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb76fd-cb27-4baf-a409-bae40d38b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.443739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb76fd-cb27-4baf-a409-bae40d38b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.444016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb76fd-cb27-4baf-a409-bae40d38b4f8 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.444653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb76fd-cb27-4baf-a409-bae40d38b4f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:00.444949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb76fd-cb27-4baf-a409-bae40d38b4f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:00.446315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb76fd-cb27-4baf-a409-bae40d38b4f8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:00.457048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 455/911] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 24 07:37:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:00.457907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:00.459079 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb76fd-cb27-4baf-a409-bae40d38b4f8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:00.531710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf538527-a3ce-45eb-b670-69da9f39dda4 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:00.569402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d6b70-88bb-4e05-95a5-2ef278a87258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:00.570160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d6b70-88bb-4e05-95a5-2ef278a87258 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.570443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d6b70-88bb-4e05-95a5-2ef278a87258 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.570713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d6b70-88bb-4e05-95a5-2ef278a87258 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.571316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d6b70-88bb-4e05-95a5-2ef278a87258 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:00.572905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d6b70-88bb-4e05-95a5-2ef278a87258 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:00.575666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb76fd-cb27-4baf-a409-bae40d38b4f8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-ef4d6b70-88bb-4e05-95a5-2ef278a87258 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:00.582556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:00.583531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:00.584396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 457/912] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 24 07:37:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:00.585175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d6b70-88bb-4e05-95a5-2ef278a87258 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:00.616221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43404f87-c4c5-4c82-90d1-66c37d45f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:00.616829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43404f87-c4c5-4c82-90d1-66c37d45f2f2 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.617116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43404f87-c4c5-4c82-90d1-66c37d45f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.617391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43404f87-c4c5-4c82-90d1-66c37d45f2f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.618063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43404f87-c4c5-4c82-90d1-66c37d45f2f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:00.619456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43404f87-c4c5-4c82-90d1-66c37d45f2f2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:00.691063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 456/913] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:37:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:00.691822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d6b70-88bb-4e05-95a5-2ef278a87258 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:00.691963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43404f87-c4c5-4c82-90d1-66c37d45f2f2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:00.707619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:00.717032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:00.758072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37741b7-645e-4cb3-8f56-bb94aec2f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:00.759451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37741b7-645e-4cb3-8f56-bb94aec2f40c None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.760009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37741b7-645e-4cb3-8f56-bb94aec2f40c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.761084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37741b7-645e-4cb3-8f56-bb94aec2f40c None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.762161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37741b7-645e-4cb3-8f56-bb94aec2f40c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:00.764124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37741b7-645e-4cb3-8f56-bb94aec2f40c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:00.817223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43404f87-c4c5-4c82-90d1-66c37d45f2f2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:00.836117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 458/914] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:37:00 2022] POST /identity/v3/services => generated 241 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:00.869521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0139f-0d06-4dd3-bd85-f0eb87554af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:00.870137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0139f-0d06-4dd3-bd85-f0eb87554af4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:00.870414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0139f-0d06-4dd3-bd85-f0eb87554af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:00.870684 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0139f-0d06-4dd3-bd85-f0eb87554af4 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:00.872314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0139f-0d06-4dd3-bd85-f0eb87554af4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:00.872314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0139f-0d06-4dd3-bd85-f0eb87554af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:00.873209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0139f-0d06-4dd3-bd85-f0eb87554af4 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:00.880622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 457/915] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:37:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:00.887236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37741b7-645e-4cb3-8f56-bb94aec2f40c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:01.008452 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37741b7-645e-4cb3-8f56-bb94aec2f40c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:01.044709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bfff0-4425-4d34-9a18-ccdce094a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:01.045321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bfff0-4425-4d34-9a18-ccdce094a519 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:01.045885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bfff0-4425-4d34-9a18-ccdce094a519 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:01.046042 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bfff0-4425-4d34-9a18-ccdce094a519 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:01.046647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bfff0-4425-4d34-9a18-ccdce094a519 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:01.046946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bfff0-4425-4d34-9a18-ccdce094a519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:01.049226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bfff0-4425-4d34-9a18-ccdce094a519 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:01.059160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 459/916] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:37:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:01.060573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0139f-0d06-4dd3-bd85-f0eb87554af4 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:01.143759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:01.169504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0139f-0d06-4dd3-bd85-f0eb87554af4 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:01.206849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971d864-1f9f-439d-9855-6a556aaac4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:01.207502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971d864-1f9f-439d-9855-6a556aaac4ad None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:01.207758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971d864-1f9f-439d-9855-6a556aaac4ad None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:01.208035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971d864-1f9f-439d-9855-6a556aaac4ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:01.208743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971d864-1f9f-439d-9855-6a556aaac4ad None admin] RBAC: Adding query filter params (interface=public, service_id=73626b79b0954ead8798545cc929f34c, region_id=RegionOne) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:01.209059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971d864-1f9f-439d-9855-6a556aaac4ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:01.210425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971d864-1f9f-439d-9855-6a556aaac4ad None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:01.220092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 458/917] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 07:37:01 2022] GET /identity/v3/endpoints?service_id=73626b79b0954ead8798545cc929f34c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:01.222638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bfff0-4425-4d34-9a18-ccdce094a519 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:01.254175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:01.331664 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bfff0-4425-4d34-9a18-ccdce094a519 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:01.379811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a193f4c-21bb-4231-ad4c-106faa1d5724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:01.380424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a193f4c-21bb-4231-ad4c-106faa1d5724 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:01.380703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a193f4c-21bb-4231-ad4c-106faa1d5724 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:01.380976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a193f4c-21bb-4231-ad4c-106faa1d5724 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:01.381583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a193f4c-21bb-4231-ad4c-106faa1d5724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:01.382955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a193f4c-21bb-4231-ad4c-106faa1d5724 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:01.389995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 460/918] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 07:37:01 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:37:01.549332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f2fa-02fd-4e3b-a710-00133a862913 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:01.549692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f2fa-02fd-4e3b-a710-00133a862913 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:01.549852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f2fa-02fd-4e3b-a710-00133a862913 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:01.551730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 459/919] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:01.556850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978cdb3-f692-43d2-876c-ff893180b9ad None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:01.557144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978cdb3-f692-43d2-876c-ff893180b9ad None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:01.557426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978cdb3-f692-43d2-876c-ff893180b9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:01.575749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-4978cdb3-f692-43d2-876c-ff893180b9ad None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:01.577477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4978cdb3-f692-43d2-876c-ff893180b9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:01.645849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 461/920] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:01.926245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f2fa-02fd-4e3b-a710-00133a862913 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:02.036705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f2fa-02fd-4e3b-a710-00133a862913 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:02.073915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b930c98-df14-4c1d-a343-d481b42589d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:02.074534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930c98-df14-4c1d-a343-d481b42589d0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.074810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930c98-df14-4c1d-a343-d481b42589d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.075079 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930c98-df14-4c1d-a343-d481b42589d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.078416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:02.086918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b930c98-df14-4c1d-a343-d481b42589d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-9b930c98-df14-4c1d-a343-d481b42589d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:02.091878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:02.097807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:02.099451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 460/921] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 07:37:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:02.101077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978cdb3-f692-43d2-876c-ff893180b9ad None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:02.123078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:02.206026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978cdb3-f692-43d2-876c-ff893180b9ad None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:02.242058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12824ec4-ef48-4bec-928e-c62b5d21521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:02.242659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12824ec4-ef48-4bec-928e-c62b5d21521e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.242946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12824ec4-ef48-4bec-928e-c62b5d21521e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.243214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12824ec4-ef48-4bec-928e-c62b5d21521e None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.243909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12824ec4-ef48-4bec-928e-c62b5d21521e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:02.244210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12824ec4-ef48-4bec-928e-c62b5d21521e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:02.245573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12824ec4-ef48-4bec-928e-c62b5d21521e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:02.254362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 462/922] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 07:37:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:02.260685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b930c98-df14-4c1d-a343-d481b42589d0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:02.368775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b930c98-df14-4c1d-a343-d481b42589d0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:02.404987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e434414-6760-4a7e-b335-aceff4ca58a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:02.405667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e434414-6760-4a7e-b335-aceff4ca58a2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.405947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e434414-6760-4a7e-b335-aceff4ca58a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.406222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e434414-6760-4a7e-b335-aceff4ca58a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.416731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e434414-6760-4a7e-b335-aceff4ca58a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:02.418187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e434414-6760-4a7e-b335-aceff4ca58a2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-8e434414-6760-4a7e-b335-aceff4ca58a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:02.434212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:02.436595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:02.438688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:02.438688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:02.438688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:02.438688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 461/923] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:02.441280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12824ec4-ef48-4bec-928e-c62b5d21521e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:02.532212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:02.558727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12824ec4-ef48-4bec-928e-c62b5d21521e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:02.602247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1709e-5858-4f33-a178-5308381313b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:02.602855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1709e-5858-4f33-a178-5308381313b0 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.603144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1709e-5858-4f33-a178-5308381313b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.603462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1709e-5858-4f33-a178-5308381313b0 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.604106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1709e-5858-4f33-a178-5308381313b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:02.604406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1709e-5858-4f33-a178-5308381313b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:02.605778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1709e-5858-4f33-a178-5308381313b0 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:02.618657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 463/924] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:02.624610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e434414-6760-4a7e-b335-aceff4ca58a2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:02.687850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:02.723221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee2ea8-da23-43b1-af6a-d58b8db8f262 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.723221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee2ea8-da23-43b1-af6a-d58b8db8f262 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.723221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee2ea8-da23-43b1-af6a-d58b8db8f262 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.724069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 464/925] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:02.729144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4278a-48e4-4b0e-bb37-fadac98af42a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.729671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4278a-48e4-4b0e-bb37-fadac98af42a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.730148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4278a-48e4-4b0e-bb37-fadac98af42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.731893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e434414-6760-4a7e-b335-aceff4ca58a2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:02.750443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-38d4278a-48e4-4b0e-bb37-fadac98af42a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:02.751975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-38d4278a-48e4-4b0e-bb37-fadac98af42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:02.769368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31eeb-a414-4202-af5b-6c72f5108689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:02.769994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31eeb-a414-4202-af5b-6c72f5108689 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.770273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31eeb-a414-4202-af5b-6c72f5108689 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.770544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31eeb-a414-4202-af5b-6c72f5108689 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.778964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31eeb-a414-4202-af5b-6c72f5108689 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:02.781134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31eeb-a414-4202-af5b-6c72f5108689 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-28e31eeb-a414-4202-af5b-6c72f5108689 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:37:02.793498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:02.794415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:37:02.795440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:02.796149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 462/926] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:37:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:02.801332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31eeb-a414-4202-af5b-6c72f5108689 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:02.838594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 465/927] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:02.917793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31eeb-a414-4202-af5b-6c72f5108689 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:02.929233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:02.958485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cf508-b6f1-4f17-a2db-6b5a96861bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:02.958485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cf508-b6f1-4f17-a2db-6b5a96861bff None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.958485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cf508-b6f1-4f17-a2db-6b5a96861bff None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.958485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cf508-b6f1-4f17-a2db-6b5a96861bff None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.958895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cf508-b6f1-4f17-a2db-6b5a96861bff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:02.958895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cf508-b6f1-4f17-a2db-6b5a96861bff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:02.959016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834cf508-b6f1-4f17-a2db-6b5a96861bff None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:02.960175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadbfb0-c562-410b-939d-7e82bbf9c50d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.960525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadbfb0-c562-410b-939d-7e82bbf9c50d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.960805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadbfb0-c562-410b-939d-7e82bbf9c50d None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.962354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 466/928] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:02.969785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce56e-1482-4dc4-bb53-c1a622ca9490 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:02.970065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce56e-1482-4dc4-bb53-c1a622ca9490 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:02.970326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce56e-1482-4dc4-bb53-c1a622ca9490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:02.979140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 463/929] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 07:37:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:02.985200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cf508-b6f1-4f17-a2db-6b5a96861bff None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:02.997698 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-cefce56e-1482-4dc4-bb53-c1a622ca9490 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:02.999905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cefce56e-1482-4dc4-bb53-c1a622ca9490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:03.083864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 467/930] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:03.091219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cf508-b6f1-4f17-a2db-6b5a96861bff None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:03.126606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1194d8f-ee09-4aa9-883d-92f645f25931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:03.127245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1194d8f-ee09-4aa9-883d-92f645f25931 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.127642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1194d8f-ee09-4aa9-883d-92f645f25931 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.127935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1194d8f-ee09-4aa9-883d-92f645f25931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.128908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefce56e-1482-4dc4-bb53-c1a622ca9490 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:03.138564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1194d8f-ee09-4aa9-883d-92f645f25931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:03.138924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:03.140572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1194d8f-ee09-4aa9-883d-92f645f25931 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-f1194d8f-ee09-4aa9-883d-92f645f25931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:03.155821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:03.156820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:03.157729 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:03.157729 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:03.157729 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:03.157729 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 464/931] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:03.162446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1194d8f-ee09-4aa9-883d-92f645f25931 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:03.190097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:03.250499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefce56e-1482-4dc4-bb53-c1a622ca9490 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:03.287505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:03.288872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.289276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.289782 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.290580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:03.292273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:03.295266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WARNING keystone.server.flask.common [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 07:37:03.299542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1194d8f-ee09-4aa9-883d-92f645f25931 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:03.345168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7b08e-5949-4001-b239-704934cd3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:03.346026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7b08e-5949-4001-b239-704934cd3c46 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.346466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7b08e-5949-4001-b239-704934cd3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.346946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7b08e-5949-4001-b239-704934cd3c46 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.347864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7b08e-5949-4001-b239-704934cd3c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:03.348329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7b08e-5949-4001-b239-704934cd3c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:03.349886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7b08e-5949-4001-b239-704934cd3c46 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:03.353632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.sql.core [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:37:03.353632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 07:37:03.353632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [parameters: {'id': '1c3aec67a9f7445e843141b9902958c5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 07:37:03.353632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88251) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:37:03.366792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 465/932] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:03.371926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7b08e-5949-4001-b239-704934cd3c46 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1c3aec67a9f7445e843141b9902958c5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1c3aec67a9f7445e843141b9902958c5. Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:37:03.377444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application result.read() Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 07:37:03.378480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application yield resource Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise self.value Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application session.commit() Aug 24 07:37:03.379750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:37:03.381109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:37:03.382310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application result.read() Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:37:03.384109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [parameters: {'id': '1c3aec67a9f7445e843141b9902958c5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:03.386451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:03.388523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1c3aec67a9f7445e843141b9902958c5. Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 468/933] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Aug 24 07:37:03 2022] POST /identity/v3/projects => generated 262 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:03.395751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:03.462202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:03.474024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:03.495454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7b08e-5949-4001-b239-704934cd3c46 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:03.507281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87302f-b195-4010-b423-558f3b9c4265 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:03.530437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef346895-8b6f-40bd-ac39-29eca67aa581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:03.531159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef346895-8b6f-40bd-ac39-29eca67aa581 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.531465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef346895-8b6f-40bd-ac39-29eca67aa581 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.531734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef346895-8b6f-40bd-ac39-29eca67aa581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.538907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef346895-8b6f-40bd-ac39-29eca67aa581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:03.540374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef346895-8b6f-40bd-ac39-29eca67aa581 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:03.543936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a63b7-0280-433f-9431-fe8870a5c901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:03.544562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a63b7-0280-433f-9431-fe8870a5c901 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.544866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a63b7-0280-433f-9431-fe8870a5c901 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.545144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a63b7-0280-433f-9431-fe8870a5c901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-ef346895-8b6f-40bd-ac39-29eca67aa581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:37:03.552405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:03.553441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:03.554532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:37:03.554532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:37:03.554532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:37:03.554532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:37:03.554532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:37:03.554532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:37:03.554532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:03.554532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:03.555064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a63b7-0280-433f-9431-fe8870a5c901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:03.555572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 466/934] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:03.555873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a63b7-0280-433f-9431-fe8870a5c901 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:03.556472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef346895-8b6f-40bd-ac39-29eca67aa581 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-255a63b7-0280-433f-9431-fe8870a5c901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:37:03.567220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:03.568305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 469/935] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e75c12-ed38-45b0-9b4c-ced0e8ef4ebe None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.574210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e75c12-ed38-45b0-9b4c-ced0e8ef4ebe None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.574872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e75c12-ed38-45b0-9b4c-ced0e8ef4ebe None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.574872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 470/936] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:03.575459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e75c12-ed38-45b0-9b4c-ced0e8ef4ebe None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:03.657798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef346895-8b6f-40bd-ac39-29eca67aa581 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:03.678081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e75c12-ed38-45b0-9b4c-ced0e8ef4ebe None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:03.692875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa58d3-2e58-4fa9-8cfc-c53da0d67889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:03.693494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa58d3-2e58-4fa9-8cfc-c53da0d67889 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.693769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa58d3-2e58-4fa9-8cfc-c53da0d67889 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.694038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa58d3-2e58-4fa9-8cfc-c53da0d67889 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.694606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa58d3-2e58-4fa9-8cfc-c53da0d67889 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:03.695345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:03.695999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa58d3-2e58-4fa9-8cfc-c53da0d67889 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-e9fa58d3-2e58-4fa9-8cfc-c53da0d67889 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:03.705178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:03.707474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:03.708488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 467/937] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:37:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:03.709459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa58d3-2e58-4fa9-8cfc-c53da0d67889 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:03.712456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:03.715645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b164755-86da-40d7-b8ac-70f4713b8b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:03.716257 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164755-86da-40d7-b8ac-70f4713b8b61 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.716537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164755-86da-40d7-b8ac-70f4713b8b61 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.716811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164755-86da-40d7-b8ac-70f4713b8b61 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.718054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b164755-86da-40d7-b8ac-70f4713b8b61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:03.718362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b164755-86da-40d7-b8ac-70f4713b8b61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:03.720043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b164755-86da-40d7-b8ac-70f4713b8b61 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:03.733854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 471/938] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:03.735145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168a82-6c23-4ac9-84a5-c112f98631e7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.735462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168a82-6c23-4ac9-84a5-c112f98631e7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.735738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168a82-6c23-4ac9-84a5-c112f98631e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.753870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-0c168a82-6c23-4ac9-84a5-c112f98631e7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:03.755422 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0c168a82-6c23-4ac9-84a5-c112f98631e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:03.808208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa58d3-2e58-4fa9-8cfc-c53da0d67889 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:03.824292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 472/939] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:03.825124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c168a82-6c23-4ac9-84a5-c112f98631e7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:03.854830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef83f1-6e1c-4ac9-9fe4-ca0c2b4d4ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:03.855711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef83f1-6e1c-4ac9-9fe4-ca0c2b4d4ef8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.856138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef83f1-6e1c-4ac9-9fe4-ca0c2b4d4ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.856557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef83f1-6e1c-4ac9-9fe4-ca0c2b4d4ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.857477 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef83f1-6e1c-4ac9-9fe4-ca0c2b4d4ef8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:03.859250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef83f1-6e1c-4ac9-9fe4-ca0c2b4d4ef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:03.860874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef83f1-6e1c-4ac9-9fe4-ca0c2b4d4ef8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:03.887558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 468/940] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:37:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:03.890845 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef83f1-6e1c-4ac9-9fe4-ca0c2b4d4ef8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:03.935495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c168a82-6c23-4ac9-84a5-c112f98631e7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:03.941533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:03.971110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01cdab-93c7-4c48-a469-4b20fd5306e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:03.971864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01cdab-93c7-4c48-a469-4b20fd5306e9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:03.972297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01cdab-93c7-4c48-a469-4b20fd5306e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:03.972637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01cdab-93c7-4c48-a469-4b20fd5306e9 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:03.973453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01cdab-93c7-4c48-a469-4b20fd5306e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:03.973825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01cdab-93c7-4c48-a469-4b20fd5306e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:03.975796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:03.976389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01cdab-93c7-4c48-a469-4b20fd5306e9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:03.987382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 473/941] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:37:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:03.989141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01cdab-93c7-4c48-a469-4b20fd5306e9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:04.027626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef83f1-6e1c-4ac9-9fe4-ca0c2b4d4ef8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:04.074225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a549c8-eb95-4fc6-86d9-afde09307178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:04.075039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a549c8-eb95-4fc6-86d9-afde09307178 None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:04.076250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a549c8-eb95-4fc6-86d9-afde09307178 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:04.076250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a549c8-eb95-4fc6-86d9-afde09307178 None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/79129c52456e4455bce3179d1e056fb0/roles/692f6347c3684ae090a246e0ed558ef1` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:04.080714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a549c8-eb95-4fc6-86d9-afde09307178 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=79129c52456e4455bce3179d1e056fb0, role_id=692f6347c3684ae090a246e0ed558ef1)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:04.081326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a549c8-eb95-4fc6-86d9-afde09307178 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:04.118901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01cdab-93c7-4c48-a469-4b20fd5306e9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:04.153349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cb821-05f2-45f6-b802-677f20cffb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:04.153958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cb821-05f2-45f6-b802-677f20cffb55 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:04.154241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cb821-05f2-45f6-b802-677f20cffb55 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:04.154516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cb821-05f2-45f6-b802-677f20cffb55 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:04.155721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cb821-05f2-45f6-b802-677f20cffb55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:04.156097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cb821-05f2-45f6-b802-677f20cffb55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:04.157403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cb821-05f2-45f6-b802-677f20cffb55 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:04.162339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 474/942] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:37:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:04.163281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cb821-05f2-45f6-b802-677f20cffb55 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:04.194759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 469/943] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:37:03 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/79129c52456e4455bce3179d1e056fb0/roles/692f6347c3684ae090a246e0ed558ef1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:37:04.195660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a549c8-eb95-4fc6-86d9-afde09307178 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:04.204327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:04.282052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cb821-05f2-45f6-b802-677f20cffb55 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:04.324399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560b95b-1198-4b3b-bbe3-ef18e7a1d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:04.325051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560b95b-1198-4b3b-bbe3-ef18e7a1d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:04.325310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560b95b-1198-4b3b-bbe3-ef18e7a1d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:04.325575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560b95b-1198-4b3b-bbe3-ef18e7a1d4b1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:04.326155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560b95b-1198-4b3b-bbe3-ef18e7a1d4b1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:04.328240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560b95b-1198-4b3b-bbe3-ef18e7a1d4b1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-8560b95b-1198-4b3b-bbe3-ef18e7a1d4b1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:04.338319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:04.339360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:04.340263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 475/944] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 24 07:37:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:04.351977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560b95b-1198-4b3b-bbe3-ef18e7a1d4b1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:04.353578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a549c8-eb95-4fc6-86d9-afde09307178 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:04.387792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:04.402358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3218a-dc8f-44e4-9cf0-db53f69d35a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:04.403091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3218a-dc8f-44e4-9cf0-db53f69d35a8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:04.403481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3218a-dc8f-44e4-9cf0-db53f69d35a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:04.408592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3218a-dc8f-44e4-9cf0-db53f69d35a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:04.408592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3218a-dc8f-44e4-9cf0-db53f69d35a8 None admin] RBAC: Adding query filter params (interface=public, service_id=746965d7e66846418e059e1e93b0908b, region_id=RegionOne) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:04.408592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3218a-dc8f-44e4-9cf0-db53f69d35a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:04.408592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3218a-dc8f-44e4-9cf0-db53f69d35a8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:04.412915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 470/945] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 07:37:04 2022] GET /identity/v3/endpoints?service_id=746965d7e66846418e059e1e93b0908b&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:04.418843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3218a-dc8f-44e4-9cf0-db53f69d35a8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:04.481227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560b95b-1198-4b3b-bbe3-ef18e7a1d4b1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:04.483731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:04.537134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3218a-dc8f-44e4-9cf0-db53f69d35a8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:04.543966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd579dfa-6a87-48c3-9761-103fab9f2945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:04.544598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd579dfa-6a87-48c3-9761-103fab9f2945 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:04.544891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd579dfa-6a87-48c3-9761-103fab9f2945 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:04.547709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd579dfa-6a87-48c3-9761-103fab9f2945 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:04.549006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd579dfa-6a87-48c3-9761-103fab9f2945 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:04.549327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd579dfa-6a87-48c3-9761-103fab9f2945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:04.551486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd579dfa-6a87-48c3-9761-103fab9f2945 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:04.558803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 476/946] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:37:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:04.564724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd579dfa-6a87-48c3-9761-103fab9f2945 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:04.588607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df39e7-c6dd-4ea9-9aaa-8977bd1d7a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:04.589633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df39e7-c6dd-4ea9-9aaa-8977bd1d7a8f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:04.590378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df39e7-c6dd-4ea9-9aaa-8977bd1d7a8f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:04.590825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df39e7-c6dd-4ea9-9aaa-8977bd1d7a8f None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:04.591629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df39e7-c6dd-4ea9-9aaa-8977bd1d7a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:04.593672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df39e7-c6dd-4ea9-9aaa-8977bd1d7a8f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:04.601966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 471/947] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 07:37:04 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:37:04.686714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd579dfa-6a87-48c3-9761-103fab9f2945 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:04.724684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdbb7a-1900-46e9-b5cf-e8715afe3605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:04.725655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdbb7a-1900-46e9-b5cf-e8715afe3605 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:04.726106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdbb7a-1900-46e9-b5cf-e8715afe3605 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:04.726573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdbb7a-1900-46e9-b5cf-e8715afe3605 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:04.727424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdbb7a-1900-46e9-b5cf-e8715afe3605 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:04.727901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdbb7a-1900-46e9-b5cf-e8715afe3605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:04.729460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdbb7a-1900-46e9-b5cf-e8715afe3605 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:04.736079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 477/948] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:37:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:04.744434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df39e7-c6dd-4ea9-9aaa-8977bd1d7a8f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:04.803710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:04.860952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df39e7-c6dd-4ea9-9aaa-8977bd1d7a8f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:04.902652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12433435-b4c9-4990-ac44-f558df29f2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:04.903381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12433435-b4c9-4990-ac44-f558df29f2f5 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:04.903731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12433435-b4c9-4990-ac44-f558df29f2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:04.904125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12433435-b4c9-4990-ac44-f558df29f2f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:04.905439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12433435-b4c9-4990-ac44-f558df29f2f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:04.906896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12433435-b4c9-4990-ac44-f558df29f2f5 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:05.100122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 472/949] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:37:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:05.929989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc1204-d726-4d3e-a815-adada7e31ac7 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:05.930550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc1204-d726-4d3e-a815-adada7e31ac7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:05.930550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc1204-d726-4d3e-a815-adada7e31ac7 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:05.931979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 478/950] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:05.939537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9a5dd-bae5-4659-a237-d5ed7c1891d2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:05.939537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9a5dd-bae5-4659-a237-d5ed7c1891d2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:05.939537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9a5dd-bae5-4659-a237-d5ed7c1891d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:05.957889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-44c9a5dd-bae5-4659-a237-d5ed7c1891d2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:05.959417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-44c9a5dd-bae5-4659-a237-d5ed7c1891d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:06.043446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 473/951] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:06.246468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed41bf-3583-4fd3-b6e0-bd5f73621e65 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:06.246832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed41bf-3583-4fd3-b6e0-bd5f73621e65 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:06.247037 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed41bf-3583-4fd3-b6e0-bd5f73621e65 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:06.248838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 479/952] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:06.254293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111dc27-63f1-4bbf-b878-a2d8752e30a4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:06.254578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111dc27-63f1-4bbf-b878-a2d8752e30a4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:06.254857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111dc27-63f1-4bbf-b878-a2d8752e30a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:06.272875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8111dc27-63f1-4bbf-b878-a2d8752e30a4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:06.274063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8111dc27-63f1-4bbf-b878-a2d8752e30a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:06.301261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:06.326193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed41bf-3583-4fd3-b6e0-bd5f73621e65 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:06.350141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 474/953] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:06.387722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:06.443564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed41bf-3583-4fd3-b6e0-bd5f73621e65 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:06.478905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:06.479952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:06.480440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:06.480922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:06.481757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:06.487315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:06.534714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.sql.core [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:37:06.534714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 07:37:06.534714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [parameters: {'user_id': '3c49889ef8894cd8a221b72d0e00bd08', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 07:37:06.534714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88251) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application result.read() Aug 24 07:37:06.542809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:37:06.543757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application yield resource Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise self.value Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application session.commit() Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:37:06.544771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:37:06.546219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:37:06.548445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application result.read() Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:37:06.550899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [parameters: {'user_id': '3c49889ef8894cd8a221b72d0e00bd08', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:06.553041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 07:37:06.555002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 07:37:06.558998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 07:37:06.558998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 07:37:06.558998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:37:06.558998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:37:06.558998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 07:37:06.558998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:06.564316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 480/954] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 24 07:37:06 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:06.568386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111dc27-63f1-4bbf-b878-a2d8752e30a4 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:06.627132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:06.689210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111dc27-63f1-4bbf-b878-a2d8752e30a4 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:06.726708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026565d5-98aa-428f-9ea5-fb43e60146f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:06.727370 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026565d5-98aa-428f-9ea5-fb43e60146f7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:06.727656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026565d5-98aa-428f-9ea5-fb43e60146f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:06.727930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026565d5-98aa-428f-9ea5-fb43e60146f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:06.735460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:06.736934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026565d5-98aa-428f-9ea5-fb43e60146f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:06.738379 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026565d5-98aa-428f-9ea5-fb43e60146f7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:06.745114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cb43b-d5b2-421a-af45-5f004a32ed61 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-026565d5-98aa-428f-9ea5-fb43e60146f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:37:06.751517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:06.752781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:06.753887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 475/955] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:37:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:06.754920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a9877-e0a7-4388-81f5-e0a7a25a0cf8 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:06.755201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a9877-e0a7-4388-81f5-e0a7a25a0cf8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:06.755675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a9877-e0a7-4388-81f5-e0a7a25a0cf8 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:06.759332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 476/956] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:06.761633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a9877-e0a7-4388-81f5-e0a7a25a0cf8 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:06.786261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015874-3405-4e1b-b469-386509a2e52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:06.786819 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015874-3405-4e1b-b469-386509a2e52f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:06.787101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015874-3405-4e1b-b469-386509a2e52f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:06.787402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015874-3405-4e1b-b469-386509a2e52f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:06.791819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:06.800335 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015874-3405-4e1b-b469-386509a2e52f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-53015874-3405-4e1b-b469-386509a2e52f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:06.805332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:06.806451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:06.807459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 481/957] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 07:37:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:06.808196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df931558-87ab-4ce5-b32f-3886e23d3fb5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:06.808494 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df931558-87ab-4ce5-b32f-3886e23d3fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:06.808742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df931558-87ab-4ce5-b32f-3886e23d3fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:06.827640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-df931558-87ab-4ce5-b32f-3886e23d3fb5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:06.829181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-df931558-87ab-4ce5-b32f-3886e23d3fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:06.885948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a9877-e0a7-4388-81f5-e0a7a25a0cf8 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:06.903921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 482/958] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:06.904723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df931558-87ab-4ce5-b32f-3886e23d3fb5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:06.937670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f127d82-e9df-467d-818a-ae36f55ebdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:06.939195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127d82-e9df-467d-818a-ae36f55ebdd5 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:06.939702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127d82-e9df-467d-818a-ae36f55ebdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:06.940679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127d82-e9df-467d-818a-ae36f55ebdd5 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:06.941819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f127d82-e9df-467d-818a-ae36f55ebdd5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:06.943216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f127d82-e9df-467d-818a-ae36f55ebdd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:06.944931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f127d82-e9df-467d-818a-ae36f55ebdd5 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:06.994923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:07.003938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 477/959] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 24 07:37:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:07.018779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df931558-87ab-4ce5-b32f-3886e23d3fb5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.042852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67f52-f5e9-4f56-9cf7-96633047a732 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.043143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67f52-f5e9-4f56-9cf7-96633047a732 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.043512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67f52-f5e9-4f56-9cf7-96633047a732 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.045903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 478/960] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:07.052957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb2409-f17e-47a6-92f8-b975b23d31c4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.053466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb2409-f17e-47a6-92f8-b975b23d31c4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.053985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb2409-f17e-47a6-92f8-b975b23d31c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.067952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c22afd-4055-4373-b147-c8424bb96ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.068582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c22afd-4055-4373-b147-c8424bb96ad1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.068875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c22afd-4055-4373-b147-c8424bb96ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.069876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c22afd-4055-4373-b147-c8424bb96ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.070573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c22afd-4055-4373-b147-c8424bb96ad1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:07.070877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c22afd-4055-4373-b147-c8424bb96ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.072831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c22afd-4055-4373-b147-c8424bb96ad1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.075959 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-cdfb2409-f17e-47a6-92f8-b975b23d31c4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:07.077479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cdfb2409-f17e-47a6-92f8-b975b23d31c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:07.087741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 483/961] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 07:37:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:07.095106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c22afd-4055-4373-b147-c8424bb96ad1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.160975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 479/962] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:07.183141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb2409-f17e-47a6-92f8-b975b23d31c4 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.196880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:07.209453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c22afd-4055-4373-b147-c8424bb96ad1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.253496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaade718-35e5-47cf-884a-29aec337db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.254150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaade718-35e5-47cf-884a-29aec337db65 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.254425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaade718-35e5-47cf-884a-29aec337db65 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.254700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaade718-35e5-47cf-884a-29aec337db65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.269316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaade718-35e5-47cf-884a-29aec337db65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.270861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaade718-35e5-47cf-884a-29aec337db65 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.275006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-aaade718-35e5-47cf-884a-29aec337db65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:07.290854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:07.293542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:07.294696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:07.294696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:07.294696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:07.294696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 484/963] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:07.302825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaade718-35e5-47cf-884a-29aec337db65 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.309419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb2409-f17e-47a6-92f8-b975b23d31c4 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.350965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bcc4e-26ec-4e25-a519-afaae3ce2567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.351625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bcc4e-26ec-4e25-a519-afaae3ce2567 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.352212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bcc4e-26ec-4e25-a519-afaae3ce2567 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.352483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bcc4e-26ec-4e25-a519-afaae3ce2567 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.353142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bcc4e-26ec-4e25-a519-afaae3ce2567 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.355462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bcc4e-26ec-4e25-a519-afaae3ce2567 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-c24bcc4e-26ec-4e25-a519-afaae3ce2567 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:07.369209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:07.370253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:07.371167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 480/964] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:07.377490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bcc4e-26ec-4e25-a519-afaae3ce2567 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.415694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaade718-35e5-47cf-884a-29aec337db65 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.449680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683637f3-fec7-4430-8b46-49e227e9d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.450308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683637f3-fec7-4430-8b46-49e227e9d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.450589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683637f3-fec7-4430-8b46-49e227e9d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.450856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683637f3-fec7-4430-8b46-49e227e9d0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.451623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683637f3-fec7-4430-8b46-49e227e9d0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:07.451967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683637f3-fec7-4430-8b46-49e227e9d0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.453326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683637f3-fec7-4430-8b46-49e227e9d0c9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.460825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:07.464755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 485/965] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:07.465539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683637f3-fec7-4430-8b46-49e227e9d0c9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.486325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bcc4e-26ec-4e25-a519-afaae3ce2567 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.520337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:07.521072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85b936-3f3d-4b13-8834-70e531ae46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.521746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85b936-3f3d-4b13-8834-70e531ae46fe None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.522093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85b936-3f3d-4b13-8834-70e531ae46fe None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.522429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85b936-3f3d-4b13-8834-70e531ae46fe None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.523115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85b936-3f3d-4b13-8834-70e531ae46fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:07.523507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85b936-3f3d-4b13-8834-70e531ae46fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.525006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85b936-3f3d-4b13-8834-70e531ae46fe None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.529903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 481/966] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:07.530666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85b936-3f3d-4b13-8834-70e531ae46fe None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.565416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683637f3-fec7-4430-8b46-49e227e9d0c9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.599457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdc6f0-6e2a-448a-b145-79221a3615ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.600085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdc6f0-6e2a-448a-b145-79221a3615ee None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.600368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdc6f0-6e2a-448a-b145-79221a3615ee None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.600646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdc6f0-6e2a-448a-b145-79221a3615ee None admin] PATH_INFO: `/v3/services/compute` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.601225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdc6f0-6e2a-448a-b145-79221a3615ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.602605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdc6f0-6e2a-448a-b145-79221a3615ee None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-bdfdc6f0-6e2a-448a-b145-79221a3615ee None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:07.611265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:07.612455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:37:07.613523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:07.615452 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 486/967] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:07.616289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdc6f0-6e2a-448a-b145-79221a3615ee None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.634341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85b936-3f3d-4b13-8834-70e531ae46fe None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.668108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75999b31-a119-49d7-9972-30de68f51b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.668967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75999b31-a119-49d7-9972-30de68f51b23 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.669249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75999b31-a119-49d7-9972-30de68f51b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.669526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75999b31-a119-49d7-9972-30de68f51b23 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.678003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75999b31-a119-49d7-9972-30de68f51b23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.680425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75999b31-a119-49d7-9972-30de68f51b23 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.682919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-75999b31-a119-49d7-9972-30de68f51b23 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:37:07.693594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:07.700528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 482/968] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:07.701609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75999b31-a119-49d7-9972-30de68f51b23 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.716734 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdc6f0-6e2a-448a-b145-79221a3615ee None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.734560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:07.751402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae30a-fbc7-4e98-b0b9-d15592c7d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.752009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae30a-fbc7-4e98-b0b9-d15592c7d551 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.752290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae30a-fbc7-4e98-b0b9-d15592c7d551 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.752563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae30a-fbc7-4e98-b0b9-d15592c7d551 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.753186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ae30a-fbc7-4e98-b0b9-d15592c7d551 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:07.753488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ae30a-fbc7-4e98-b0b9-d15592c7d551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.754858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ae30a-fbc7-4e98-b0b9-d15592c7d551 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.759821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 487/969] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:07.760518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae30a-fbc7-4e98-b0b9-d15592c7d551 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.799413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75999b31-a119-49d7-9972-30de68f51b23 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.833466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d1a39-75a8-45cf-8b60-425c59b91317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.833999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d1a39-75a8-45cf-8b60-425c59b91317 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.834280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d1a39-75a8-45cf-8b60-425c59b91317 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.834551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d1a39-75a8-45cf-8b60-425c59b91317 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.835177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d1a39-75a8-45cf-8b60-425c59b91317 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:07.835513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d1a39-75a8-45cf-8b60-425c59b91317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.836872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d1a39-75a8-45cf-8b60-425c59b91317 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.841394 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 483/970] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:07.842703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d1a39-75a8-45cf-8b60-425c59b91317 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.867081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae30a-fbc7-4e98-b0b9-d15592c7d551 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.902070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cedd89-fa9a-4aeb-86f5-e102caae0866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.902670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cedd89-fa9a-4aeb-86f5-e102caae0866 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.902966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cedd89-fa9a-4aeb-86f5-e102caae0866 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.903242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cedd89-fa9a-4aeb-86f5-e102caae0866 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.903798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:07.904001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cedd89-fa9a-4aeb-86f5-e102caae0866 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:07.904345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cedd89-fa9a-4aeb-86f5-e102caae0866 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.905795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cedd89-fa9a-4aeb-86f5-e102caae0866 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:07.923434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 488/971] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:07.924251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cedd89-fa9a-4aeb-86f5-e102caae0866 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:07.943067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d1a39-75a8-45cf-8b60-425c59b91317 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:07.965761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:07.976946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efa11c-d786-424d-a660-d85eed02ada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:07.977550 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efa11c-d786-424d-a660-d85eed02ada6 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:07.977836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efa11c-d786-424d-a660-d85eed02ada6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:07.978108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efa11c-d786-424d-a660-d85eed02ada6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:07.978763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efa11c-d786-424d-a660-d85eed02ada6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:07.980241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efa11c-d786-424d-a660-d85eed02ada6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:08.023280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cedd89-fa9a-4aeb-86f5-e102caae0866 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:08.057149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4eef2-64ac-4fc8-8f90-6e73c07ec187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:08.057773 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4eef2-64ac-4fc8-8f90-6e73c07ec187 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:08.058052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4eef2-64ac-4fc8-8f90-6e73c07ec187 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:08.058336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4eef2-64ac-4fc8-8f90-6e73c07ec187 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:08.058952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4eef2-64ac-4fc8-8f90-6e73c07ec187 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:08.059253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4eef2-64ac-4fc8-8f90-6e73c07ec187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:08.061306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4eef2-64ac-4fc8-8f90-6e73c07ec187 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:08.065661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 489/972] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:37:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:08.066436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4eef2-64ac-4fc8-8f90-6e73c07ec187 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:08.088713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 484/973] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:37:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:08.196699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4eef2-64ac-4fc8-8f90-6e73c07ec187 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:08.199670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:08.245998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295cb52-1cc5-42dc-82ae-0bf7effd04de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:08.246857 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295cb52-1cc5-42dc-82ae-0bf7effd04de None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:08.247145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295cb52-1cc5-42dc-82ae-0bf7effd04de None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:08.247467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295cb52-1cc5-42dc-82ae-0bf7effd04de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:08.318161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295cb52-1cc5-42dc-82ae-0bf7effd04de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:08.319648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295cb52-1cc5-42dc-82ae-0bf7effd04de None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:08.429389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:08.438544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 490/974] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:37:08.439812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efa11c-d786-424d-a660-d85eed02ada6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:08.542634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efa11c-d786-424d-a660-d85eed02ada6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:08.561543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:08.578441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a1d81-d764-4e6f-85d5-1f31b5f3976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:08.579072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a1d81-d764-4e6f-85d5-1f31b5f3976d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:08.579385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a1d81-d764-4e6f-85d5-1f31b5f3976d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:08.579666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a1d81-d764-4e6f-85d5-1f31b5f3976d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:08.590341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a1d81-d764-4e6f-85d5-1f31b5f3976d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:08.592363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a1d81-d764-4e6f-85d5-1f31b5f3976d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-a20a1d81-d764-4e6f-85d5-1f31b5f3976d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:08.606856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:08.608124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:08.609230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:08.609230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:08.609230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:08.615783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 485/975] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:08.617013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295cb52-1cc5-42dc-82ae-0bf7effd04de None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:08.724585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295cb52-1cc5-42dc-82ae-0bf7effd04de None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:08.759802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d082b-6788-4abf-ad99-2632f0e38425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:08.760409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d082b-6788-4abf-ad99-2632f0e38425 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:08.760689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d082b-6788-4abf-ad99-2632f0e38425 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:08.760962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d082b-6788-4abf-ad99-2632f0e38425 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:08.761599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d082b-6788-4abf-ad99-2632f0e38425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:08.761900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d082b-6788-4abf-ad99-2632f0e38425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:08.763270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d082b-6788-4abf-ad99-2632f0e38425 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:08.775049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 491/976] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:08.780871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a1d81-d764-4e6f-85d5-1f31b5f3976d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:08.881603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a1d81-d764-4e6f-85d5-1f31b5f3976d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:08.914620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce3c6a-a8f7-4093-b602-b6ac502d3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:08.915234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce3c6a-a8f7-4093-b602-b6ac502d3859 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:08.915539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce3c6a-a8f7-4093-b602-b6ac502d3859 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:08.915813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce3c6a-a8f7-4093-b602-b6ac502d3859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:08.922676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce3c6a-a8f7-4093-b602-b6ac502d3859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:08.924137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce3c6a-a8f7-4093-b602-b6ac502d3859 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-86ce3c6a-a8f7-4093-b602-b6ac502d3859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:37:08.935541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:08.936454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:08.937483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:37:08.937483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:37:08.937483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:37:08.937483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:37:08.937483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:37:08.937483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:37:08.937483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:08.937483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:08.938600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 486/977] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:08.942381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d082b-6788-4abf-ad99-2632f0e38425 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:09.008081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:09.051047 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d082b-6788-4abf-ad99-2632f0e38425 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:09.086259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfb46c-746f-4438-bab0-021b04bfc18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:09.086873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb46c-746f-4438-bab0-021b04bfc18e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:09.087154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb46c-746f-4438-bab0-021b04bfc18e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:09.087456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb46c-746f-4438-bab0-021b04bfc18e None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:09.088152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb46c-746f-4438-bab0-021b04bfc18e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:09.088457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb46c-746f-4438-bab0-021b04bfc18e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:09.089888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb46c-746f-4438-bab0-021b04bfc18e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:09.103624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 492/978] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:09.110727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce3c6a-a8f7-4093-b602-b6ac502d3859 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:09.142681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:09.218428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce3c6a-a8f7-4093-b602-b6ac502d3859 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:09.252721 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e87aa-ce5c-4a25-83a4-a046669a893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:09.253448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e87aa-ce5c-4a25-83a4-a046669a893f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:09.253845 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e87aa-ce5c-4a25-83a4-a046669a893f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:09.254214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e87aa-ce5c-4a25-83a4-a046669a893f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:09.255028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e87aa-ce5c-4a25-83a4-a046669a893f None admin] RBAC: Adding query filter params (role.id=692f6347c3684ae090a246e0ed558ef1, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=79129c52456e4455bce3179d1e056fb0) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:09.255467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e87aa-ce5c-4a25-83a4-a046669a893f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:09.256975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e87aa-ce5c-4a25-83a4-a046669a893f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:09.262868 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 487/979] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:37:09 2022] GET /identity/v3/role_assignments?user.id=79129c52456e4455bce3179d1e056fb0&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=692f6347c3684ae090a246e0ed558ef1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:10.021026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f00ec7-1480-4c93-b32f-94c72f592b06 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:10.021436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f00ec7-1480-4c93-b32f-94c72f592b06 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:10.021627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f00ec7-1480-4c93-b32f-94c72f592b06 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:10.023092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 493/980] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:10.028201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1eb21-cbb2-438d-9cee-4b65196bf1e6 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:10.028492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1eb21-cbb2-438d-9cee-4b65196bf1e6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:10.028768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1eb21-cbb2-438d-9cee-4b65196bf1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:10.046222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ffab-0fca-4ff8-858b-d0ba84640cd5 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:10.046496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ffab-0fca-4ff8-858b-d0ba84640cd5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:10.046799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ffab-0fca-4ff8-858b-d0ba84640cd5 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:10.047693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-0dc1eb21-cbb2-438d-9cee-4b65196bf1e6 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:10.048241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 494/981] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:10.048947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0dc1eb21-cbb2-438d-9cee-4b65196bf1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:10.053208 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70e3b-e3ec-4095-b4cd-fe541806b96c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:10.053643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70e3b-e3ec-4095-b4cd-fe541806b96c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:10.053736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70e3b-e3ec-4095-b4cd-fe541806b96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:10.071496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c1a70e3b-e3ec-4095-b4cd-fe541806b96c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:10.072667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c1a70e3b-e3ec-4095-b4cd-fe541806b96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:10.121931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 488/982] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:10.145905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 495/983] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:10.398395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1eb21-cbb2-438d-9cee-4b65196bf1e6 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:10.424150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a70e3b-e3ec-4095-b4cd-fe541806b96c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:10.432661 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:10.480442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:10.515336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1eb21-cbb2-438d-9cee-4b65196bf1e6 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:10.534829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a70e3b-e3ec-4095-b4cd-fe541806b96c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:10.552242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce3249-aaeb-42eb-b3f8-e4014397241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:10.553282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce3249-aaeb-42eb-b3f8-e4014397241e None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:10.553282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce3249-aaeb-42eb-b3f8-e4014397241e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:10.553492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce3249-aaeb-42eb-b3f8-e4014397241e None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:10.554057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce3249-aaeb-42eb-b3f8-e4014397241e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:10.555438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce3249-aaeb-42eb-b3f8-e4014397241e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:10.571211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d39dfd-f524-4a6c-9dc6-b493a9534a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:10.571930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d39dfd-f524-4a6c-9dc6-b493a9534a16 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:10.572217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d39dfd-f524-4a6c-9dc6-b493a9534a16 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:10.572689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d39dfd-f524-4a6c-9dc6-b493a9534a16 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:10.573278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d39dfd-f524-4a6c-9dc6-b493a9534a16 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:10.574645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d39dfd-f524-4a6c-9dc6-b493a9534a16 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-77d39dfd-f524-4a6c-9dc6-b493a9534a16 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:10.587731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:10.588981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:10.590081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:10.594798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 496/984] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:37:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:10.595529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d39dfd-f524-4a6c-9dc6-b493a9534a16 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:10.641630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 489/985] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:37:10 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:10.729459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d39dfd-f524-4a6c-9dc6-b493a9534a16 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:10.744916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:10.775147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de169f1-3cec-427a-bb1e-8487e6256989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:10.775956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de169f1-3cec-427a-bb1e-8487e6256989 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:10.776332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de169f1-3cec-427a-bb1e-8487e6256989 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:10.776700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de169f1-3cec-427a-bb1e-8487e6256989 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:10.777436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de169f1-3cec-427a-bb1e-8487e6256989 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:10.777855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de169f1-3cec-427a-bb1e-8487e6256989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:10.780051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de169f1-3cec-427a-bb1e-8487e6256989 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:10.785620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 497/986] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:37:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:10.791688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce3249-aaeb-42eb-b3f8-e4014397241e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:10.888257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:10.905989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce3249-aaeb-42eb-b3f8-e4014397241e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:10.942287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a719-1ccd-4219-8410-b1cedf893877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:10.942990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a719-1ccd-4219-8410-b1cedf893877 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:10.943375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a719-1ccd-4219-8410-b1cedf893877 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:10.943727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a719-1ccd-4219-8410-b1cedf893877 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:10.944425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a719-1ccd-4219-8410-b1cedf893877 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:10.944847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a719-1ccd-4219-8410-b1cedf893877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:10.946395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a719-1ccd-4219-8410-b1cedf893877 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:10.951660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 490/987] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:37:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:10.957300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de169f1-3cec-427a-bb1e-8487e6256989 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:11.061522 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de169f1-3cec-427a-bb1e-8487e6256989 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:11.096373 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0641-6cc1-4c2d-ba67-92d057d091f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:11.096989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0641-6cc1-4c2d-ba67-92d057d091f5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:11.097279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0641-6cc1-4c2d-ba67-92d057d091f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:11.097560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0641-6cc1-4c2d-ba67-92d057d091f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:11.098270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d0641-6cc1-4c2d-ba67-92d057d091f5 None admin] RBAC: Adding query filter params (interface=admin, service_id=746965d7e66846418e059e1e93b0908b, region_id=RegionOne) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:11.098578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d0641-6cc1-4c2d-ba67-92d057d091f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:11.099977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d0641-6cc1-4c2d-ba67-92d057d091f5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:11.109842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 498/988] 10.222.0.17 () {56 vars in 1249 bytes} [Wed Aug 24 07:37:10 2022] GET /identity/v3/endpoints?service_id=746965d7e66846418e059e1e93b0908b&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:11.111393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a719-1ccd-4219-8410-b1cedf893877 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:11.218940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a719-1ccd-4219-8410-b1cedf893877 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:11.225061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64725c-c764-41fc-8e5f-b5f2933a976f None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:11.225349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64725c-c764-41fc-8e5f-b5f2933a976f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:11.225623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64725c-c764-41fc-8e5f-b5f2933a976f None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:11.227330 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 499/989] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:11.231873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076198c1-1613-4bcc-be6a-2a1ccbe4cae5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:11.232255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076198c1-1613-4bcc-be6a-2a1ccbe4cae5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:11.232529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076198c1-1613-4bcc-be6a-2a1ccbe4cae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:11.249884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-076198c1-1613-4bcc-be6a-2a1ccbe4cae5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:11.251056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-076198c1-1613-4bcc-be6a-2a1ccbe4cae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:11.256996 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ec3bb-9f65-41d3-b282-4830467df5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:11.257605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ec3bb-9f65-41d3-b282-4830467df5db None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:11.257878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ec3bb-9f65-41d3-b282-4830467df5db None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:11.258161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ec3bb-9f65-41d3-b282-4830467df5db None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:11.259165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ec3bb-9f65-41d3-b282-4830467df5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:11.260946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ec3bb-9f65-41d3-b282-4830467df5db None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:11.275688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 491/990] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 07:37:11 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:37:11.283166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:11.326596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 500/991] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:11.598510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ec3bb-9f65-41d3-b282-4830467df5db None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:11.613913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:11.700151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ec3bb-9f65-41d3-b282-4830467df5db None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:11.737142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df83896-8c66-4548-b619-cd29255123a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:11.737766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df83896-8c66-4548-b619-cd29255123a1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:11.738042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df83896-8c66-4548-b619-cd29255123a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:11.738313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df83896-8c66-4548-b619-cd29255123a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:11.738887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df83896-8c66-4548-b619-cd29255123a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:11.740262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df83896-8c66-4548-b619-cd29255123a1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-7df83896-8c66-4548-b619-cd29255123a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:11.748934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:11.750082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:11.750912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 492/992] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 24 07:37:11 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:11.756017 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076198c1-1613-4bcc-be6a-2a1ccbe4cae5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:11.856825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076198c1-1613-4bcc-be6a-2a1ccbe4cae5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:11.892546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6b1dd-5251-4af8-8f36-de1e2f780e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:11.893153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6b1dd-5251-4af8-8f36-de1e2f780e80 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:11.893442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6b1dd-5251-4af8-8f36-de1e2f780e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:11.893856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6b1dd-5251-4af8-8f36-de1e2f780e80 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:11.894491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6b1dd-5251-4af8-8f36-de1e2f780e80 None admin] RBAC: Adding query filter params (name=image) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:11.894792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6b1dd-5251-4af8-8f36-de1e2f780e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:11.896181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6b1dd-5251-4af8-8f36-de1e2f780e80 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:11.906503 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 501/993] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:11.907500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df83896-8c66-4548-b619-cd29255123a1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:11.984902 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:12.008565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df83896-8c66-4548-b619-cd29255123a1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:12.042336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ec4f1-c296-4828-b418-87ab0ae8dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:12.042936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ec4f1-c296-4828-b418-87ab0ae8dff8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:12.043264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ec4f1-c296-4828-b418-87ab0ae8dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:12.043569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ec4f1-c296-4828-b418-87ab0ae8dff8 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:12.044230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ec4f1-c296-4828-b418-87ab0ae8dff8 None admin] RBAC: Adding query filter params (type=image) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:12.044532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ec4f1-c296-4828-b418-87ab0ae8dff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:12.046572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ec4f1-c296-4828-b418-87ab0ae8dff8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:12.059374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 493/994] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:12.598247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccbb3b-628a-4880-af75-8f683e5a4300 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:12.598755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccbb3b-628a-4880-af75-8f683e5a4300 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:12.598832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccbb3b-628a-4880-af75-8f683e5a4300 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:12.600293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 502/995] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:12.605286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c10869-1ad5-4b1b-ad2c-d78957cfab7b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:12.605670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c10869-1ad5-4b1b-ad2c-d78957cfab7b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:12.605839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c10869-1ad5-4b1b-ad2c-d78957cfab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:12.624421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-39c10869-1ad5-4b1b-ad2c-d78957cfab7b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:12.625526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-39c10869-1ad5-4b1b-ad2c-d78957cfab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:12.694529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 494/996] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:12.962474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccbb3b-628a-4880-af75-8f683e5a4300 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:12.994640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:13.072706 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccbb3b-628a-4880-af75-8f683e5a4300 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:13.107141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afe8b1-84b8-41a1-b3da-39980661c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:13.108520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afe8b1-84b8-41a1-b3da-39980661c355 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:13.108809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afe8b1-84b8-41a1-b3da-39980661c355 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:13.109137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afe8b1-84b8-41a1-b3da-39980661c355 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:13.109722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afe8b1-84b8-41a1-b3da-39980661c355 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:13.111090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afe8b1-84b8-41a1-b3da-39980661c355 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-91afe8b1-84b8-41a1-b3da-39980661c355 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:13.120040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:13.121097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:37:13.122101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:13.125617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 503/997] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:37:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:13.127769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c10869-1ad5-4b1b-ad2c-d78957cfab7b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:13.202866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e59b-99d3-423a-b745-f88b937cef98 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:13.203189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e59b-99d3-423a-b745-f88b937cef98 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:13.203458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e59b-99d3-423a-b745-f88b937cef98 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:13.204034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:13.205089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 504/998] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:13.210123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb1057-00c0-4276-9ede-a24e28aed145 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:13.217674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb1057-00c0-4276-9ede-a24e28aed145 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:13.217674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb1057-00c0-4276-9ede-a24e28aed145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:13.229234 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d9bb1057-00c0-4276-9ede-a24e28aed145 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:13.230382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d9bb1057-00c0-4276-9ede-a24e28aed145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:13.235433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c10869-1ad5-4b1b-ad2c-d78957cfab7b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:13.270154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23383215-43f8-42d6-86b1-70aee92c3ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:13.270758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23383215-43f8-42d6-86b1-70aee92c3ea9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:13.271074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23383215-43f8-42d6-86b1-70aee92c3ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:13.271386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23383215-43f8-42d6-86b1-70aee92c3ea9 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:13.272019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23383215-43f8-42d6-86b1-70aee92c3ea9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:13.272323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23383215-43f8-42d6-86b1-70aee92c3ea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:13.273675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23383215-43f8-42d6-86b1-70aee92c3ea9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:13.278399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 495/999] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:37:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:13.284436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23383215-43f8-42d6-86b1-70aee92c3ea9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:13.300359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 505/1000] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:13.399715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23383215-43f8-42d6-86b1-70aee92c3ea9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:13.433819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126871db-6884-447e-ab31-d55343f039e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:13.434416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126871db-6884-447e-ab31-d55343f039e1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:13.434694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126871db-6884-447e-ab31-d55343f039e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:13.434965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126871db-6884-447e-ab31-d55343f039e1 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:13.435848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126871db-6884-447e-ab31-d55343f039e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:13.436157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126871db-6884-447e-ab31-d55343f039e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:13.437537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126871db-6884-447e-ab31-d55343f039e1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:13.438750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:13.448145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 496/1001] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:37:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:13.452079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb1057-00c0-4276-9ede-a24e28aed145 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:13.477882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:13.551346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb1057-00c0-4276-9ede-a24e28aed145 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:13.570898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126871db-6884-447e-ab31-d55343f039e1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:13.590323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51322e8-5e1a-4427-accc-4f319bdf5a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:13.590943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51322e8-5e1a-4427-accc-4f319bdf5a0c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:13.591229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51322e8-5e1a-4427-accc-4f319bdf5a0c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:13.592099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51322e8-5e1a-4427-accc-4f319bdf5a0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:13.592811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51322e8-5e1a-4427-accc-4f319bdf5a0c None admin] RBAC: Adding query filter params (interface=public, service_id=e94eccafac874626b734b03e5ddd7dda, region_id=RegionOne) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:13.593121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51322e8-5e1a-4427-accc-4f319bdf5a0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:13.594496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51322e8-5e1a-4427-accc-4f319bdf5a0c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:13.599772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 506/1002] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 07:37:13 2022] GET /identity/v3/endpoints?service_id=e94eccafac874626b734b03e5ddd7dda&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:13.605182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51322e8-5e1a-4427-accc-4f319bdf5a0c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:13.679047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126871db-6884-447e-ab31-d55343f039e1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:13.703323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:13.714110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51322e8-5e1a-4427-accc-4f319bdf5a0c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:13.721560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f0408-aa31-4a5b-9727-1ca89240e640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:13.722201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f0408-aa31-4a5b-9727-1ca89240e640 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:13.722480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f0408-aa31-4a5b-9727-1ca89240e640 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:13.722754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f0408-aa31-4a5b-9727-1ca89240e640 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:13.723350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f0408-aa31-4a5b-9727-1ca89240e640 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:13.724716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f0408-aa31-4a5b-9727-1ca89240e640 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-9d1f0408-aa31-4a5b-9727-1ca89240e640 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:13.734018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:13.735029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:13.736795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 497/1003] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 24 07:37:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:13.740881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f0408-aa31-4a5b-9727-1ca89240e640 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:13.757148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4b713-d7a1-4e0c-887e-fc9f17d60fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:13.757856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4b713-d7a1-4e0c-887e-fc9f17d60fb3 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:13.758144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4b713-d7a1-4e0c-887e-fc9f17d60fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:13.758424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4b713-d7a1-4e0c-887e-fc9f17d60fb3 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:13.759037 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4b713-d7a1-4e0c-887e-fc9f17d60fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:13.760450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4b713-d7a1-4e0c-887e-fc9f17d60fb3 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:13.767886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 507/1004] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 07:37:13 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:37:13.825594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:13.869145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f0408-aa31-4a5b-9727-1ca89240e640 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:13.908493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e2314-b10c-46d2-9b10-75ecaedb7a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:13.909154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2314-b10c-46d2-9b10-75ecaedb7a55 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:13.909405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2314-b10c-46d2-9b10-75ecaedb7a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:13.909685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e2314-b10c-46d2-9b10-75ecaedb7a55 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:13.910327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e2314-b10c-46d2-9b10-75ecaedb7a55 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:13.910628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e2314-b10c-46d2-9b10-75ecaedb7a55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:13.912056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e2314-b10c-46d2-9b10-75ecaedb7a55 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:13.917770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 498/1005] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:37:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:13.925660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4b713-d7a1-4e0c-887e-fc9f17d60fb3 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:14.039336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e51b-7557-4fc2-aeac-bda6e728bf53 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:14.039786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e51b-7557-4fc2-aeac-bda6e728bf53 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:14.040259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e51b-7557-4fc2-aeac-bda6e728bf53 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:14.042377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 499/1006] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:14.046558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4b713-d7a1-4e0c-887e-fc9f17d60fb3 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:14.048438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00547f9-0c01-4d59-b23f-fdda4a78bb34 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:14.048813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00547f9-0c01-4d59-b23f-fdda4a78bb34 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:14.049093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00547f9-0c01-4d59-b23f-fdda4a78bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:14.070308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b00547f9-0c01-4d59-b23f-fdda4a78bb34 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:14.071530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b00547f9-0c01-4d59-b23f-fdda4a78bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:14.089259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c126-2eff-400c-be84-9b985de06ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:14.089883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c126-2eff-400c-be84-9b985de06ff5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:14.090350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c126-2eff-400c-be84-9b985de06ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:14.090647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c126-2eff-400c-be84-9b985de06ff5 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:14.091346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7c126-2eff-400c-be84-9b985de06ff5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:14.091728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7c126-2eff-400c-be84-9b985de06ff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:14.093278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7c126-2eff-400c-be84-9b985de06ff5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:14.098485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 508/1007] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 24 07:37:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:14.104507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c126-2eff-400c-be84-9b985de06ff5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:14.125628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:14.158157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 500/1008] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:14.217688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c126-2eff-400c-be84-9b985de06ff5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:14.257267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fe57d-4fa6-410f-81c3-2b58e48cbb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:14.257878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fe57d-4fa6-410f-81c3-2b58e48cbb66 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:14.258170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fe57d-4fa6-410f-81c3-2b58e48cbb66 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:14.258452 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fe57d-4fa6-410f-81c3-2b58e48cbb66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:14.259114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fe57d-4fa6-410f-81c3-2b58e48cbb66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:14.260520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fe57d-4fa6-410f-81c3-2b58e48cbb66 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:14.343397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 509/1009] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:37:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:14.466205 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00547f9-0c01-4d59-b23f-fdda4a78bb34 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:14.529621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:14.582368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00547f9-0c01-4d59-b23f-fdda4a78bb34 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:14.626457 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b562d1-f279-4b12-bc9b-ddd3dd3ea432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:14.626984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b562d1-f279-4b12-bc9b-ddd3dd3ea432 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:14.627266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b562d1-f279-4b12-bc9b-ddd3dd3ea432 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:14.627568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b562d1-f279-4b12-bc9b-ddd3dd3ea432 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:14.628214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b562d1-f279-4b12-bc9b-ddd3dd3ea432 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:14.629595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b562d1-f279-4b12-bc9b-ddd3dd3ea432 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:14.740824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 501/1010] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:37:14 2022] POST /identity/v3/services => generated 242 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:15.864873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28361ff7-b786-4826-9857-8a02a7da6b78 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:15.865417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28361ff7-b786-4826-9857-8a02a7da6b78 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:15.865417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28361ff7-b786-4826-9857-8a02a7da6b78 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:15.866786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 510/1011] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:15.872052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f52b2-ffd4-4305-8611-c489fb42e6d6 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:15.872552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f52b2-ffd4-4305-8611-c489fb42e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:15.872805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f52b2-ffd4-4305-8611-c489fb42e6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:15.892106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-da0f52b2-ffd4-4305-8611-c489fb42e6d6 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:15.893272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-da0f52b2-ffd4-4305-8611-c489fb42e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:16.014139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 502/1012] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:15 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:16.285116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28361ff7-b786-4826-9857-8a02a7da6b78 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:16.318708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8213c-59b2-44aa-98c9-e86e598f035a None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:16.318895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8213c-59b2-44aa-98c9-e86e598f035a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:16.319166 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8213c-59b2-44aa-98c9-e86e598f035a None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:16.320513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 503/1013] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:16.326287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cf4f3-949e-4733-a9ca-9731cc9b5d9b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:16.326572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cf4f3-949e-4733-a9ca-9731cc9b5d9b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:16.326911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cf4f3-949e-4733-a9ca-9731cc9b5d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:16.349456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-603cf4f3-949e-4733-a9ca-9731cc9b5d9b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:16.351567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-603cf4f3-949e-4733-a9ca-9731cc9b5d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:16.376013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:16.390296 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:16.398338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28361ff7-b786-4826-9857-8a02a7da6b78 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:16.428902 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 504/1014] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:16.432545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b34704-3e05-41b4-a8ad-b5ae5c2167aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:16.433177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b34704-3e05-41b4-a8ad-b5ae5c2167aa None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:16.433453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b34704-3e05-41b4-a8ad-b5ae5c2167aa None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:16.433723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b34704-3e05-41b4-a8ad-b5ae5c2167aa None admin] PATH_INFO: `/v3/services/compute` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:16.434297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b34704-3e05-41b4-a8ad-b5ae5c2167aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:16.435832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b34704-3e05-41b4-a8ad-b5ae5c2167aa None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-44b34704-3e05-41b4-a8ad-b5ae5c2167aa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:16.444789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:16.445769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:16.446612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 511/1015] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:37:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:16.453131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cf4f3-949e-4733-a9ca-9731cc9b5d9b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:16.555198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cf4f3-949e-4733-a9ca-9731cc9b5d9b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:16.588758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186f976-091e-4a59-bb27-f20213a64526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:16.589370 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f976-091e-4a59-bb27-f20213a64526 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:16.589655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f976-091e-4a59-bb27-f20213a64526 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:16.589920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f976-091e-4a59-bb27-f20213a64526 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:16.590537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f976-091e-4a59-bb27-f20213a64526 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:16.590834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f976-091e-4a59-bb27-f20213a64526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:16.592875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f976-091e-4a59-bb27-f20213a64526 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:16.597930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 505/1016] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:37:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:16.603533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b34704-3e05-41b4-a8ad-b5ae5c2167aa None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:16.679514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a295523-b757-4312-ae14-c22b5572099e None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:16.679799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a295523-b757-4312-ae14-c22b5572099e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:16.680079 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a295523-b757-4312-ae14-c22b5572099e None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:16.681436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 506/1017] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:16.687321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7fb8-bd42-4aeb-a91c-c18908079ed7 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:16.687705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7fb8-bd42-4aeb-a91c-c18908079ed7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:16.688042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7fb8-bd42-4aeb-a91c-c18908079ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:16.707178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ddfe7fb8-bd42-4aeb-a91c-c18908079ed7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:16.708381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ddfe7fb8-bd42-4aeb-a91c-c18908079ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:16.712371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b34704-3e05-41b4-a8ad-b5ae5c2167aa None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:16.735536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:16.746051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464170b-3660-4e12-8ddc-b821a723e9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:16.746658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464170b-3660-4e12-8ddc-b821a723e9b0 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:16.747467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464170b-3660-4e12-8ddc-b821a723e9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:16.747467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464170b-3660-4e12-8ddc-b821a723e9b0 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:16.747874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464170b-3660-4e12-8ddc-b821a723e9b0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:16.748180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464170b-3660-4e12-8ddc-b821a723e9b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:16.749550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464170b-3660-4e12-8ddc-b821a723e9b0 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:16.754327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 512/1018] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 24 07:37:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:16.755111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464170b-3660-4e12-8ddc-b821a723e9b0 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:16.763774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:16.780199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 507/1019] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:16.781084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe7fb8-bd42-4aeb-a91c-c18908079ed7 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:16.861422 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464170b-3660-4e12-8ddc-b821a723e9b0 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:16.884963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe7fb8-bd42-4aeb-a91c-c18908079ed7 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:16.895386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41989e-e4e1-43a1-bf90-69277b8ead3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:16.896012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41989e-e4e1-43a1-bf90-69277b8ead3d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:16.896294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41989e-e4e1-43a1-bf90-69277b8ead3d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:16.896563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41989e-e4e1-43a1-bf90-69277b8ead3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:16.897655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41989e-e4e1-43a1-bf90-69277b8ead3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:16.899068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41989e-e4e1-43a1-bf90-69277b8ead3d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:16.900654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 513/1020] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:16.906828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41989e-e4e1-43a1-bf90-69277b8ead3d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:16.921208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580db80f-1ab9-471d-a34a-4420eccb9ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:16.921814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580db80f-1ab9-471d-a34a-4420eccb9ba6 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:16.922089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580db80f-1ab9-471d-a34a-4420eccb9ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:16.922360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580db80f-1ab9-471d-a34a-4420eccb9ba6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:16.923006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580db80f-1ab9-471d-a34a-4420eccb9ba6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:16.924638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580db80f-1ab9-471d-a34a-4420eccb9ba6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:16.984172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:17.008101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41989e-e4e1-43a1-bf90-69277b8ead3d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:17.042252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 508/1021] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:37:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:17.048919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580db80f-1ab9-471d-a34a-4420eccb9ba6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:17.055680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba54e38-bbe7-42c2-a40b-8bf9d954a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:17.056312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba54e38-bbe7-42c2-a40b-8bf9d954a65e None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:17.056590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba54e38-bbe7-42c2-a40b-8bf9d954a65e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:17.056862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba54e38-bbe7-42c2-a40b-8bf9d954a65e None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:17.057514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba54e38-bbe7-42c2-a40b-8bf9d954a65e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:17.059045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba54e38-bbe7-42c2-a40b-8bf9d954a65e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:17.070813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:17.121164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 514/1022] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:37:16 2022] POST /identity/v3/projects => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:37:17.169644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580db80f-1ab9-471d-a34a-4420eccb9ba6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:17.218899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ed8ac-4e74-4bf2-9f56-8827d571b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:17.219591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ed8ac-4e74-4bf2-9f56-8827d571b841 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:17.219870 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ed8ac-4e74-4bf2-9f56-8827d571b841 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:17.220347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ed8ac-4e74-4bf2-9f56-8827d571b841 None admin] PATH_INFO: `/v3/services/image` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:17.220940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ed8ac-4e74-4bf2-9f56-8827d571b841 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:17.222330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ed8ac-4e74-4bf2-9f56-8827d571b841 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-108ed8ac-4e74-4bf2-9f56-8827d571b841 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:17.232322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:17.233372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:17.234223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 509/1023] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 24 07:37:17 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:17.239700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba54e38-bbe7-42c2-a40b-8bf9d954a65e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:17.353977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba54e38-bbe7-42c2-a40b-8bf9d954a65e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:17.378038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:17.389799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cfe6f-092b-49ca-a10d-1f87e07822d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:17.392854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cfe6f-092b-49ca-a10d-1f87e07822d3 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:17.392854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cfe6f-092b-49ca-a10d-1f87e07822d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:17.392854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cfe6f-092b-49ca-a10d-1f87e07822d3 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:17.392854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cfe6f-092b-49ca-a10d-1f87e07822d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:17.392854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cfe6f-092b-49ca-a10d-1f87e07822d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:17.393337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cfe6f-092b-49ca-a10d-1f87e07822d3 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:17.398397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 515/1024] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:17.405102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ed8ac-4e74-4bf2-9f56-8827d571b841 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:17.492846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:17.511321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ed8ac-4e74-4bf2-9f56-8827d571b841 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:17.548335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc31373-f552-4f0f-8c95-508f29333336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:17.549641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc31373-f552-4f0f-8c95-508f29333336 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:17.550176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc31373-f552-4f0f-8c95-508f29333336 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:17.550643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc31373-f552-4f0f-8c95-508f29333336 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:17.551489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc31373-f552-4f0f-8c95-508f29333336 None admin] RBAC: Adding query filter params (type=image) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:17.551989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc31373-f552-4f0f-8c95-508f29333336 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:17.553558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc31373-f552-4f0f-8c95-508f29333336 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:17.558930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 510/1025] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:17.564532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cfe6f-092b-49ca-a10d-1f87e07822d3 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:17.668128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cfe6f-092b-49ca-a10d-1f87e07822d3 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:17.703121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc804b9-9453-4389-9622-85154abec8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:17.703752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc804b9-9453-4389-9622-85154abec8e3 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:17.704034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc804b9-9453-4389-9622-85154abec8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:17.704300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc804b9-9453-4389-9622-85154abec8e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:17.704987 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc804b9-9453-4389-9622-85154abec8e3 None admin] RBAC: Adding query filter params (interface=public, service_id=aa4de2c052e3417bb0f43bf9e3e6fe60, region_id=RegionOne) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:17.705294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc804b9-9453-4389-9622-85154abec8e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:17.706656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc804b9-9453-4389-9622-85154abec8e3 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:17.716584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 516/1026] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 07:37:17 2022] GET /identity/v3/endpoints?service_id=aa4de2c052e3417bb0f43bf9e3e6fe60&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:17.717853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc31373-f552-4f0f-8c95-508f29333336 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:17.820526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc31373-f552-4f0f-8c95-508f29333336 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:17.853615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02412940-a69b-44bd-8b22-7d0d149b6e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:17.854217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02412940-a69b-44bd-8b22-7d0d149b6e21 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:17.854495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02412940-a69b-44bd-8b22-7d0d149b6e21 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:17.854766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02412940-a69b-44bd-8b22-7d0d149b6e21 None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:17.855393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02412940-a69b-44bd-8b22-7d0d149b6e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:17.857465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02412940-a69b-44bd-8b22-7d0d149b6e21 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:17.871740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 511/1027] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 07:37:17 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:37:19.085924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4309c3-b3a8-41c3-a4d7-6239309c6bf3 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.086439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4309c3-b3a8-41c3-a4d7-6239309c6bf3 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.086518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4309c3-b3a8-41c3-a4d7-6239309c6bf3 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.088009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 517/1028] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:19.093670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385592c-f3fe-4f70-bcd8-d777abcf398b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.094055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385592c-f3fe-4f70-bcd8-d777abcf398b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.094257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385592c-f3fe-4f70-bcd8-d777abcf398b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.112256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-a385592c-f3fe-4f70-bcd8-d777abcf398b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:19.113447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a385592c-f3fe-4f70-bcd8-d777abcf398b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:19.116842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:19.160555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349808-52f3-441b-b93c-bea5e9ed386f None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.160876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349808-52f3-441b-b93c-bea5e9ed386f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.161151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349808-52f3-441b-b93c-bea5e9ed386f None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.162494 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 518/1029] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:19.167582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf17963-4aaf-4953-b4d8-56747d7ef51a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.167871 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf17963-4aaf-4953-b4d8-56747d7ef51a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.168151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf17963-4aaf-4953-b4d8-56747d7ef51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.188663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-daf17963-4aaf-4953-b4d8-56747d7ef51a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:19.189860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-daf17963-4aaf-4953-b4d8-56747d7ef51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:19.192961 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 512/1030] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:19.238683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:19.263354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 519/1031] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:19.467634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385592c-f3fe-4f70-bcd8-d777abcf398b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:19.532376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf17963-4aaf-4953-b4d8-56747d7ef51a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:19.567090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385592c-f3fe-4f70-bcd8-d777abcf398b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:19.603663 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a4edb-2d02-4dfe-ad01-33a30404b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:19.604295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a4edb-2d02-4dfe-ad01-33a30404b250 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.604577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a4edb-2d02-4dfe-ad01-33a30404b250 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.604853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a4edb-2d02-4dfe-ad01-33a30404b250 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.614595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:19.618022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a4edb-2d02-4dfe-ad01-33a30404b250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-ad9a4edb-2d02-4dfe-ad01-33a30404b250 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:19.623342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:19.624472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:19.625531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:19.627809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 513/1032] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 07:37:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:19.636354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a4edb-2d02-4dfe-ad01-33a30404b250 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:19.644820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf17963-4aaf-4953-b4d8-56747d7ef51a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:19.681450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7342a-1978-4b0d-85c2-b815844fea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:19.682211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7342a-1978-4b0d-85c2-b815844fea4a None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.682501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7342a-1978-4b0d-85c2-b815844fea4a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.682785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7342a-1978-4b0d-85c2-b815844fea4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.683938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7342a-1978-4b0d-85c2-b815844fea4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:19.686109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7342a-1978-4b0d-85c2-b815844fea4a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:19.690975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 520/1033] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:19.693380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7342a-1978-4b0d-85c2-b815844fea4a None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:19.748228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:19.752123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a4edb-2d02-4dfe-ad01-33a30404b250 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:19.787755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dfb9d-49f3-4274-a02e-0cd91ade1c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:19.788359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dfb9d-49f3-4274-a02e-0cd91ade1c52 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.788639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dfb9d-49f3-4274-a02e-0cd91ade1c52 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.788909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dfb9d-49f3-4274-a02e-0cd91ade1c52 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.789563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dfb9d-49f3-4274-a02e-0cd91ade1c52 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:19.789867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dfb9d-49f3-4274-a02e-0cd91ade1c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:19.791225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dfb9d-49f3-4274-a02e-0cd91ade1c52 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:19.799704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 514/1034] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 07:37:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:19.800418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7342a-1978-4b0d-85c2-b815844fea4a None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:19.801179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28b714-8424-48f1-9cc6-5276b2061084 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.801467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28b714-8424-48f1-9cc6-5276b2061084 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.801767 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28b714-8424-48f1-9cc6-5276b2061084 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.802955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 515/1035] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:19.805269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28b714-8424-48f1-9cc6-5276b2061084 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:19.839759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcd642-d4db-4999-96e1-2141707870a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:19.840364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd642-d4db-4999-96e1-2141707870a7 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.840647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd642-d4db-4999-96e1-2141707870a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.841093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcd642-d4db-4999-96e1-2141707870a7 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.841788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcd642-d4db-4999-96e1-2141707870a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:19.843265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcd642-d4db-4999-96e1-2141707870a7 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:19.874039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:19.906156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28b714-8424-48f1-9cc6-5276b2061084 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:19.940750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb7976-449f-44e5-86b6-25f8fe26a2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:19.941373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb7976-449f-44e5-86b6-25f8fe26a2b5 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.941649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb7976-449f-44e5-86b6-25f8fe26a2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.941920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb7976-449f-44e5-86b6-25f8fe26a2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.951210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 521/1036] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:37:19 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:37:19.953151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb7976-449f-44e5-86b6-25f8fe26a2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:19.954644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb7976-449f-44e5-86b6-25f8fe26a2b5 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:19.957038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f54137-a7fb-49b7-84a6-58bc93c130e5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:19.957293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f54137-a7fb-49b7-84a6-58bc93c130e5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:19.957509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f54137-a7fb-49b7-84a6-58bc93c130e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-54eb7976-449f-44e5-86b6-25f8fe26a2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:19.972860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:19.974136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:19.978848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:19.978848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:19.978848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:19.978848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 516/1037] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:19.983080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-96f54137-a7fb-49b7-84a6-58bc93c130e5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:19.983253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb7976-449f-44e5-86b6-25f8fe26a2b5 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:19.984451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-96f54137-a7fb-49b7-84a6-58bc93c130e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:20.070494 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 522/1038] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:20.101904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb7976-449f-44e5-86b6-25f8fe26a2b5 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:20.117987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:20.139558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38339dc-8304-4460-9935-13853c4d13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:20.140097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38339dc-8304-4460-9935-13853c4d13e3 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:20.140375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38339dc-8304-4460-9935-13853c4d13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:20.140643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38339dc-8304-4460-9935-13853c4d13e3 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:20.141272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38339dc-8304-4460-9935-13853c4d13e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:20.141571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38339dc-8304-4460-9935-13853c4d13e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:20.142908 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38339dc-8304-4460-9935-13853c4d13e3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:20.155784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 517/1039] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:20.161790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f54137-a7fb-49b7-84a6-58bc93c130e5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:20.199711 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:20.269515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f54137-a7fb-49b7-84a6-58bc93c130e5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:20.305365 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc324f-19af-4d2a-a14e-bdba4f6b841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:20.306091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc324f-19af-4d2a-a14e-bdba4f6b841e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:20.306435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc324f-19af-4d2a-a14e-bdba4f6b841e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:20.306773 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc324f-19af-4d2a-a14e-bdba4f6b841e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:20.314017 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc324f-19af-4d2a-a14e-bdba4f6b841e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:20.315567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc324f-19af-4d2a-a14e-bdba4f6b841e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-25dc324f-19af-4d2a-a14e-bdba4f6b841e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:37:20.328708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:20.329942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:37:20.331118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:20.331828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 523/1040] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 07:37:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:20.339329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38339dc-8304-4460-9935-13853c4d13e3 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:20.346549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc324f-19af-4d2a-a14e-bdba4f6b841e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:20.453729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:20.454558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38339dc-8304-4460-9935-13853c4d13e3 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:20.461122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc324f-19af-4d2a-a14e-bdba4f6b841e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:20.490433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0dd1fd-bcb0-4cea-b01e-c1d6714b15b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:20.491347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dd1fd-bcb0-4cea-b01e-c1d6714b15b2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:20.491633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dd1fd-bcb0-4cea-b01e-c1d6714b15b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:20.491910 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dd1fd-bcb0-4cea-b01e-c1d6714b15b2 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:20.492640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dd1fd-bcb0-4cea-b01e-c1d6714b15b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:20.492947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dd1fd-bcb0-4cea-b01e-c1d6714b15b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:20.494358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0dd1fd-bcb0-4cea-b01e-c1d6714b15b2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:20.500690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22588525-170b-4c03-9c33-665826050ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:20.501334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22588525-170b-4c03-9c33-665826050ed1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:20.501614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22588525-170b-4c03-9c33-665826050ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:20.501888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22588525-170b-4c03-9c33-665826050ed1 None admin] PATH_INFO: `/v3/services/image` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:20.502470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22588525-170b-4c03-9c33-665826050ed1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:20.503862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22588525-170b-4c03-9c33-665826050ed1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-22588525-170b-4c03-9c33-665826050ed1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:20.513083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:20.514160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:20.520269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 524/1041] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 24 07:37:20 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:20.521063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 518/1042] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 07:37:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:20.521138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22588525-170b-4c03-9c33-665826050ed1 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:20.521207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0dd1fd-bcb0-4cea-b01e-c1d6714b15b2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:20.554030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:20.630005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0dd1fd-bcb0-4cea-b01e-c1d6714b15b2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:20.634399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22588525-170b-4c03-9c33-665826050ed1 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:20.668795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7682d8-caa5-44d4-aa91-c1f434da7773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:20.669452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7682d8-caa5-44d4-aa91-c1f434da7773 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:20.669735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7682d8-caa5-44d4-aa91-c1f434da7773 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:20.670010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7682d8-caa5-44d4-aa91-c1f434da7773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:20.670540 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1daf-b5fb-414d-96bd-925b06d0a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:20.671389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1daf-b5fb-414d-96bd-925b06d0a920 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:20.671884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1daf-b5fb-414d-96bd-925b06d0a920 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:20.672350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1daf-b5fb-414d-96bd-925b06d0a920 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:20.673176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1daf-b5fb-414d-96bd-925b06d0a920 None admin] RBAC: Adding query filter params (name=image) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:20.673637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1daf-b5fb-414d-96bd-925b06d0a920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:20.675273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1daf-b5fb-414d-96bd-925b06d0a920 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:20.680491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 525/1043] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:20.686838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1daf-b5fb-414d-96bd-925b06d0a920 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:20.712281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:20.741636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7682d8-caa5-44d4-aa91-c1f434da7773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:20.743093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7682d8-caa5-44d4-aa91-c1f434da7773 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:20.773894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:20.791472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1daf-b5fb-414d-96bd-925b06d0a920 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:20.828386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8da92-94af-449c-bd04-65bcc35c9dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:20.828985 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8da92-94af-449c-bd04-65bcc35c9dda None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:20.829372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8da92-94af-449c-bd04-65bcc35c9dda None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:20.829640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8da92-94af-449c-bd04-65bcc35c9dda None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:20.830261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8da92-94af-449c-bd04-65bcc35c9dda None admin] RBAC: Adding query filter params (type=image) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:20.830553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8da92-94af-449c-bd04-65bcc35c9dda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:20.831940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8da92-94af-449c-bd04-65bcc35c9dda None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:20.836687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 526/1044] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:20.842582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8da92-94af-449c-bd04-65bcc35c9dda None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:20.855272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 519/1045] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:20 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:37:20.857120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7682d8-caa5-44d4-aa91-c1f434da7773 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:20.933619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:20.949122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8da92-94af-449c-bd04-65bcc35c9dda None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:20.966474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7682d8-caa5-44d4-aa91-c1f434da7773 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:20.985865 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0407222-b10e-407e-ba01-e6a8568ceb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:20.986481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0407222-b10e-407e-ba01-e6a8568ceb6d None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:20.986776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0407222-b10e-407e-ba01-e6a8568ceb6d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:20.987061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0407222-b10e-407e-ba01-e6a8568ceb6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:20.987751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0407222-b10e-407e-ba01-e6a8568ceb6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:20.989132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0407222-b10e-407e-ba01-e6a8568ceb6d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:20.996322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:21.002357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb20cd5-eedc-4d3f-a5bf-1c342fed4ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:21.005097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20cd5-eedc-4d3f-a5bf-1c342fed4ada None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:21.005097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20cd5-eedc-4d3f-a5bf-1c342fed4ada None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:21.005097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20cd5-eedc-4d3f-a5bf-1c342fed4ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:21.015071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb20cd5-eedc-4d3f-a5bf-1c342fed4ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:21.016557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb20cd5-eedc-4d3f-a5bf-1c342fed4ada None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-3eb20cd5-eedc-4d3f-a5bf-1c342fed4ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:21.032365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:21.034740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:21.035814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:21.035814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:21.035814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:21.039434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 520/1046] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:21.040517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb20cd5-eedc-4d3f-a5bf-1c342fed4ada None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:21.099328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 527/1047] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:37:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:37:21.160665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb20cd5-eedc-4d3f-a5bf-1c342fed4ada None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:21.206242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcef42c-ddc1-47f9-9899-c5226cba6087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:21.206859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcef42c-ddc1-47f9-9899-c5226cba6087 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:21.207141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcef42c-ddc1-47f9-9899-c5226cba6087 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:21.207438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcef42c-ddc1-47f9-9899-c5226cba6087 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:21.208081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcef42c-ddc1-47f9-9899-c5226cba6087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:21.208377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcef42c-ddc1-47f9-9899-c5226cba6087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:21.209739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcef42c-ddc1-47f9-9899-c5226cba6087 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:21.223523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 521/1048] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:21.231160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0407222-b10e-407e-ba01-e6a8568ceb6d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:21.345046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0407222-b10e-407e-ba01-e6a8568ceb6d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:21.382856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247e00e-ed1b-42a6-a58f-dbac8e12cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:21.383521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247e00e-ed1b-42a6-a58f-dbac8e12cc88 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:21.383802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247e00e-ed1b-42a6-a58f-dbac8e12cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:21.384076 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247e00e-ed1b-42a6-a58f-dbac8e12cc88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:21.391558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247e00e-ed1b-42a6-a58f-dbac8e12cc88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:21.393121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247e00e-ed1b-42a6-a58f-dbac8e12cc88 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-e247e00e-ed1b-42a6-a58f-dbac8e12cc88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:37:21.404411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:21.405298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:21.406318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:37:21.406318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:37:21.406318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:37:21.406318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:37:21.406318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:37:21.406318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:37:21.406318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:21.406318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:21.406318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 528/1049] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:21.411339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcef42c-ddc1-47f9-9899-c5226cba6087 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:21.456408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:21.515220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcef42c-ddc1-47f9-9899-c5226cba6087 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:21.550892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ead969-4553-44fa-9256-69e889ae9853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:21.551531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ead969-4553-44fa-9256-69e889ae9853 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:21.551811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ead969-4553-44fa-9256-69e889ae9853 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:21.552083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ead969-4553-44fa-9256-69e889ae9853 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:21.552771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ead969-4553-44fa-9256-69e889ae9853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:21.553107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ead969-4553-44fa-9256-69e889ae9853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:21.554548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ead969-4553-44fa-9256-69e889ae9853 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:21.571559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 522/1050] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:21.572937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247e00e-ed1b-42a6-a58f-dbac8e12cc88 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:21.575930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:21.678604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247e00e-ed1b-42a6-a58f-dbac8e12cc88 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:21.713077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5243f-9f32-43b8-a4d3-5e071b24da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:21.713689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5243f-9f32-43b8-a4d3-5e071b24da19 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:21.713979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5243f-9f32-43b8-a4d3-5e071b24da19 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:21.714250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5243f-9f32-43b8-a4d3-5e071b24da19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:21.714973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5243f-9f32-43b8-a4d3-5e071b24da19 None admin] RBAC: Adding query filter params (role.id=692f6347c3684ae090a246e0ed558ef1, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=7d8054e88916456991bf485c19f8b502) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:21.715280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5243f-9f32-43b8-a4d3-5e071b24da19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:21.716930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5243f-9f32-43b8-a4d3-5e071b24da19 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:21.722458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 529/1051] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:37:21 2022] GET /identity/v3/role_assignments?user.id=7d8054e88916456991bf485c19f8b502&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=692f6347c3684ae090a246e0ed558ef1 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:22.026409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712522cc-50fa-462b-bfd2-9fb19b9e038b None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:22.026774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712522cc-50fa-462b-bfd2-9fb19b9e038b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:22.026971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712522cc-50fa-462b-bfd2-9fb19b9e038b None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:22.029486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 523/1052] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:22.034551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ae068-2f96-4250-b25b-36d67d402f2f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:22.034850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ae068-2f96-4250-b25b-36d67d402f2f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:22.035138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ae068-2f96-4250-b25b-36d67d402f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:22.054028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d44ae068-2f96-4250-b25b-36d67d402f2f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:22.055215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d44ae068-2f96-4250-b25b-36d67d402f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:22.119014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:22.127763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 530/1053] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:22.407779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712522cc-50fa-462b-bfd2-9fb19b9e038b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:22.509106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:22.514674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712522cc-50fa-462b-bfd2-9fb19b9e038b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:22.551027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1d10-66d1-4f10-82af-99ef9ca34b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:22.551686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1d10-66d1-4f10-82af-99ef9ca34b9a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:22.551966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1d10-66d1-4f10-82af-99ef9ca34b9a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:22.552236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d1d10-66d1-4f10-82af-99ef9ca34b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:22.563237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d1d10-66d1-4f10-82af-99ef9ca34b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-683d1d10-66d1-4f10-82af-99ef9ca34b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:22.567994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:22.568895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:22.569728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 524/1054] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:37:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:22.577509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ae068-2f96-4250-b25b-36d67d402f2f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:22.681516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ae068-2f96-4250-b25b-36d67d402f2f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:22.717954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07ee9-a65c-4a5d-a56a-d6ba7b472c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:22.718567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07ee9-a65c-4a5d-a56a-d6ba7b472c0c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:22.718855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07ee9-a65c-4a5d-a56a-d6ba7b472c0c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:22.719176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07ee9-a65c-4a5d-a56a-d6ba7b472c0c None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:22.719876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec07ee9-a65c-4a5d-a56a-d6ba7b472c0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:22.720229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec07ee9-a65c-4a5d-a56a-d6ba7b472c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:22.721600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec07ee9-a65c-4a5d-a56a-d6ba7b472c0c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:22.730068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 531/1055] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:37:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:22.736426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1d10-66d1-4f10-82af-99ef9ca34b9a None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:22.844736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d1d10-66d1-4f10-82af-99ef9ca34b9a None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:22.879526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec2d99-8151-462c-9494-45b82700e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:22.880146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2d99-8151-462c-9494-45b82700e28a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:22.880475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2d99-8151-462c-9494-45b82700e28a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:22.880752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec2d99-8151-462c-9494-45b82700e28a None admin] PATH_INFO: `/v3/users/7f5d738be88f45e5afba9da4f05e8672` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:22.894210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec2d99-8151-462c-9494-45b82700e28a None admin] RBAC: Authorizing `identity:get_user(user_id=7f5d738be88f45e5afba9da4f05e8672)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:22.895761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec2d99-8151-462c-9494-45b82700e28a None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:22.897650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 525/1056] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:22 2022] GET /identity/v3/users/7f5d738be88f45e5afba9da4f05e8672 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:22.904806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07ee9-a65c-4a5d-a56a-d6ba7b472c0c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:22.967840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:23.012591 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07ee9-a65c-4a5d-a56a-d6ba7b472c0c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:23.049169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccd043-8e1d-41d6-b66b-6b64cfa19c69 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:23.049496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccd043-8e1d-41d6-b66b-6b64cfa19c69 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:23.049960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccd043-8e1d-41d6-b66b-6b64cfa19c69 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:23.052000 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 526/1057] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:23.052108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46f59b-fc18-4fa4-89a2-a57fee1dce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:23.052543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46f59b-fc18-4fa4-89a2-a57fee1dce63 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:23.052900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46f59b-fc18-4fa4-89a2-a57fee1dce63 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:23.053161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46f59b-fc18-4fa4-89a2-a57fee1dce63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:23.056974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fad86-0d91-4e7f-b810-c67905354639 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:23.057274 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fad86-0d91-4e7f-b810-c67905354639 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:23.057548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fad86-0d91-4e7f-b810-c67905354639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:23.077114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-fa5fad86-0d91-4e7f-b810-c67905354639 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:23.078290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fa5fad86-0d91-4e7f-b810-c67905354639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:23.093154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:23.130752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46f59b-fc18-4fa4-89a2-a57fee1dce63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:23.132233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46f59b-fc18-4fa4-89a2-a57fee1dce63 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:23.147488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 527/1058] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:23.192333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:23.237702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 532/1059] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:37:23.243510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fad86-0d91-4e7f-b810-c67905354639 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:23.352664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fad86-0d91-4e7f-b810-c67905354639 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:23.393318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616548-459c-4d80-8486-3c928b2f83f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:23.393955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616548-459c-4d80-8486-3c928b2f83f0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:23.394240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616548-459c-4d80-8486-3c928b2f83f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:23.394513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616548-459c-4d80-8486-3c928b2f83f0 None admin] PATH_INFO: `/v3/projects/2d887067d6454e989170f4ac0d2caf89` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:23.395661 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4616548-459c-4d80-8486-3c928b2f83f0 None admin] RBAC: Authorizing `identity:get_project(project_id=2d887067d6454e989170f4ac0d2caf89)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:23.397084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4616548-459c-4d80-8486-3c928b2f83f0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:23.404352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 528/1060] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:37:23 2022] GET /identity/v3/projects/2d887067d6454e989170f4ac0d2caf89 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:23.406323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46f59b-fc18-4fa4-89a2-a57fee1dce63 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:23.422618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616548-459c-4d80-8486-3c928b2f83f0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:23.442633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:23.519051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46f59b-fc18-4fa4-89a2-a57fee1dce63 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:23.530934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616548-459c-4d80-8486-3c928b2f83f0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:23.561774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89feab39-6cdd-4bd7-8b79-425d455de743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:23.562367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89feab39-6cdd-4bd7-8b79-425d455de743 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:23.562753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89feab39-6cdd-4bd7-8b79-425d455de743 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:23.563022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89feab39-6cdd-4bd7-8b79-425d455de743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:23.563883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89feab39-6cdd-4bd7-8b79-425d455de743 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=2d887067d6454e989170f4ac0d2caf89, user.id=7f5d738be88f45e5afba9da4f05e8672) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:23.564186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89feab39-6cdd-4bd7-8b79-425d455de743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:23.565723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89feab39-6cdd-4bd7-8b79-425d455de743 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:23.571180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28168900-c4bd-40cb-aee8-f676cf962094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:23.571817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28168900-c4bd-40cb-aee8-f676cf962094 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:23.572101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28168900-c4bd-40cb-aee8-f676cf962094 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:23.572374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28168900-c4bd-40cb-aee8-f676cf962094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:23.576323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 533/1061] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:37:23 2022] GET /identity/v3/role_assignments?user.id=7f5d738be88f45e5afba9da4f05e8672&scope.project.id=2d887067d6454e989170f4ac0d2caf89&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:23.624189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113559-f905-41bd-b9c4-8153bda709a5 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:23.624866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113559-f905-41bd-b9c4-8153bda709a5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:23.624866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113559-f905-41bd-b9c4-8153bda709a5 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:23.626115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 534/1062] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:23.632094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a647cf-ca3c-4eb7-833a-c9d7dafa3358 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:23.632408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a647cf-ca3c-4eb7-833a-c9d7dafa3358 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:23.632658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a647cf-ca3c-4eb7-833a-c9d7dafa3358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:23.651707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-b7a647cf-ca3c-4eb7-833a-c9d7dafa3358 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:23.653011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b7a647cf-ca3c-4eb7-833a-c9d7dafa3358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:23.661476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28168900-c4bd-40cb-aee8-f676cf962094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:23.663354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28168900-c4bd-40cb-aee8-f676cf962094 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:23.672525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:23.682095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:23.729781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 535/1063] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:23.771406 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 529/1064] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:37:23.776933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a647cf-ca3c-4eb7-833a-c9d7dafa3358 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:23.881378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a647cf-ca3c-4eb7-833a-c9d7dafa3358 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:23.917018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b225b-f001-4f37-b5e0-0ca909cf1a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:23.917861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b225b-f001-4f37-b5e0-0ca909cf1a21 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:23.918152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b225b-f001-4f37-b5e0-0ca909cf1a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:23.918432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b225b-f001-4f37-b5e0-0ca909cf1a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:23.929508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b225b-f001-4f37-b5e0-0ca909cf1a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:23.930961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b225b-f001-4f37-b5e0-0ca909cf1a21 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-452b225b-f001-4f37-b5e0-0ca909cf1a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:23.945934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:23.946914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:23.952196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:23.952196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:23.952196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:23.952196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 536/1065] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:23.954320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28168900-c4bd-40cb-aee8-f676cf962094 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:23.999928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b225b-f001-4f37-b5e0-0ca909cf1a21 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:24.003732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:24.059025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28168900-c4bd-40cb-aee8-f676cf962094 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:24.077017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:24.095436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ece50-d3c5-4262-86c2-2eb27aba8076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:24.096046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ece50-d3c5-4262-86c2-2eb27aba8076 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:24.096327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ece50-d3c5-4262-86c2-2eb27aba8076 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:24.096598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ece50-d3c5-4262-86c2-2eb27aba8076 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:24.097429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ece50-d3c5-4262-86c2-2eb27aba8076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:24.097538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ece50-d3c5-4262-86c2-2eb27aba8076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:24.098871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ece50-d3c5-4262-86c2-2eb27aba8076 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:24.111379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b225b-f001-4f37-b5e0-0ca909cf1a21 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:24.123318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 530/1066] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:24.149822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fd4ae-2548-4c5f-8d5f-efd858402a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:24.150474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fd4ae-2548-4c5f-8d5f-efd858402a60 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:24.150758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fd4ae-2548-4c5f-8d5f-efd858402a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:24.151032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fd4ae-2548-4c5f-8d5f-efd858402a60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:24.164453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fd4ae-2548-4c5f-8d5f-efd858402a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-720fd4ae-2548-4c5f-8d5f-efd858402a60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:24.169854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:24.170864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:24.172192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 537/1067] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 07:37:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:24.177579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ece50-d3c5-4262-86c2-2eb27aba8076 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:24.288147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ece50-d3c5-4262-86c2-2eb27aba8076 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:24.324046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec68fd-0bc9-4269-8101-f6165155a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:24.324588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec68fd-0bc9-4269-8101-f6165155a5b7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:24.325460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec68fd-0bc9-4269-8101-f6165155a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:24.325739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec68fd-0bc9-4269-8101-f6165155a5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:24.326393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec68fd-0bc9-4269-8101-f6165155a5b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:24.326698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec68fd-0bc9-4269-8101-f6165155a5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:24.328118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec68fd-0bc9-4269-8101-f6165155a5b7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:24.336642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 531/1068] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 07:37:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:24.343385 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fd4ae-2548-4c5f-8d5f-efd858402a60 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:24.415423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:24.454892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fd4ae-2548-4c5f-8d5f-efd858402a60 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:24.488367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009b763-d970-4a49-afe0-95cfbac65c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:24.489026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009b763-d970-4a49-afe0-95cfbac65c0b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:24.489309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009b763-d970-4a49-afe0-95cfbac65c0b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:24.489582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009b763-d970-4a49-afe0-95cfbac65c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:24.499902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009b763-d970-4a49-afe0-95cfbac65c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:24.501355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009b763-d970-4a49-afe0-95cfbac65c0b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-c009b763-d970-4a49-afe0-95cfbac65c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:24.515029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:24.516275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:24.517178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:24.517178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:24.517178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:24.517546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 538/1069] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:24.521898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec68fd-0bc9-4269-8101-f6165155a5b7 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:24.561840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:24.621712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec68fd-0bc9-4269-8101-f6165155a5b7 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:24.655897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797c77e-cd80-4535-a956-37c7dc3b46f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:24.656522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797c77e-cd80-4535-a956-37c7dc3b46f1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:24.656803 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797c77e-cd80-4535-a956-37c7dc3b46f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:24.657078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797c77e-cd80-4535-a956-37c7dc3b46f1 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:24.657742 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797c77e-cd80-4535-a956-37c7dc3b46f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:24.658046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797c77e-cd80-4535-a956-37c7dc3b46f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:24.659482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797c77e-cd80-4535-a956-37c7dc3b46f1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:24.671431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 532/1070] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:24.677357 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009b763-d970-4a49-afe0-95cfbac65c0b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:24.775781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009b763-d970-4a49-afe0-95cfbac65c0b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:24.791163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:24.809475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96a6a6-1298-469a-8737-af78bd676b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:24.810101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96a6a6-1298-469a-8737-af78bd676b6c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:24.810382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96a6a6-1298-469a-8737-af78bd676b6c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:24.810655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96a6a6-1298-469a-8737-af78bd676b6c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:24.817861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96a6a6-1298-469a-8737-af78bd676b6c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:24.819313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96a6a6-1298-469a-8737-af78bd676b6c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-8b96a6a6-1298-469a-8737-af78bd676b6c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:37:24.831541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:24.832631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:24.833582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 539/1071] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 07:37:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:24.838383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797c77e-cd80-4535-a956-37c7dc3b46f1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:24.935701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:24.939755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797c77e-cd80-4535-a956-37c7dc3b46f1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:24.973298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea6b5-5604-49aa-8d26-222b6d65469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:24.973867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea6b5-5604-49aa-8d26-222b6d65469c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:24.974351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea6b5-5604-49aa-8d26-222b6d65469c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:24.974689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea6b5-5604-49aa-8d26-222b6d65469c None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:24.975576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dea6b5-5604-49aa-8d26-222b6d65469c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:24.975928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dea6b5-5604-49aa-8d26-222b6d65469c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:24.977648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dea6b5-5604-49aa-8d26-222b6d65469c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:24.995078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 533/1072] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 07:37:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:25.001014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96a6a6-1298-469a-8737-af78bd676b6c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:25.104036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96a6a6-1298-469a-8737-af78bd676b6c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:25.137914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ceaa5-39eb-4687-99d3-23b46b18ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:25.138542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ceaa5-39eb-4687-99d3-23b46b18ac2f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:25.138825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ceaa5-39eb-4687-99d3-23b46b18ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:25.139104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ceaa5-39eb-4687-99d3-23b46b18ac2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:25.149409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ceaa5-39eb-4687-99d3-23b46b18ac2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:25.150868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ceaa5-39eb-4687-99d3-23b46b18ac2f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-6c8ceaa5-39eb-4687-99d3-23b46b18ac2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:25.165471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:25.166568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:25.167722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:25.167722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:25.167722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:25.167722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 540/1073] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:25.173022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea6b5-5604-49aa-8d26-222b6d65469c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:25.274082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea6b5-5604-49aa-8d26-222b6d65469c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:25.307879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984fffb-9c81-47a9-93ee-fef9bacd130e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:25.308459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984fffb-9c81-47a9-93ee-fef9bacd130e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:25.308769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984fffb-9c81-47a9-93ee-fef9bacd130e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:25.308994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984fffb-9c81-47a9-93ee-fef9bacd130e None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:25.310891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984fffb-9c81-47a9-93ee-fef9bacd130e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:25.310891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984fffb-9c81-47a9-93ee-fef9bacd130e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:25.311355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984fffb-9c81-47a9-93ee-fef9bacd130e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:25.322500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 534/1074] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:25.328692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ceaa5-39eb-4687-99d3-23b46b18ac2f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:25.358793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:25.429647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ceaa5-39eb-4687-99d3-23b46b18ac2f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:25.463307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86345642-05c7-4e31-95fe-c0b63d218920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:25.463938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345642-05c7-4e31-95fe-c0b63d218920 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:25.464215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345642-05c7-4e31-95fe-c0b63d218920 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:25.464494 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345642-05c7-4e31-95fe-c0b63d218920 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:25.471683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86345642-05c7-4e31-95fe-c0b63d218920 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:25.473149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86345642-05c7-4e31-95fe-c0b63d218920 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-86345642-05c7-4e31-95fe-c0b63d218920 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:37:25.484101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:25.484981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:25.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:37:25.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:37:25.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:37:25.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:37:25.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:37:25.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:37:25.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:25.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:25.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 541/1075] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:25.490955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984fffb-9c81-47a9-93ee-fef9bacd130e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:25.509026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:25.526821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e70cb-53e3-4409-aab6-1ca0199395fe None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:25.527036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e70cb-53e3-4409-aab6-1ca0199395fe None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:25.527340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e70cb-53e3-4409-aab6-1ca0199395fe None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:25.529389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 542/1076] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:25.534364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f093ba-e787-4c3f-a944-33032ed55789 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:25.534652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f093ba-e787-4c3f-a944-33032ed55789 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:25.534932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f093ba-e787-4c3f-a944-33032ed55789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:25.552859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d2f093ba-e787-4c3f-a944-33032ed55789 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:25.554045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d2f093ba-e787-4c3f-a944-33032ed55789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:25.591775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984fffb-9c81-47a9-93ee-fef9bacd130e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:25.621506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 543/1077] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:25.625050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a732ad8-e087-45d8-95c7-9ee3e1b6f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:25.625658 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732ad8-e087-45d8-95c7-9ee3e1b6f223 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:25.625938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732ad8-e087-45d8-95c7-9ee3e1b6f223 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:25.626208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732ad8-e087-45d8-95c7-9ee3e1b6f223 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:25.626890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a732ad8-e087-45d8-95c7-9ee3e1b6f223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:25.627195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a732ad8-e087-45d8-95c7-9ee3e1b6f223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:25.628640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a732ad8-e087-45d8-95c7-9ee3e1b6f223 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:25.640664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 535/1078] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:25.646501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f093ba-e787-4c3f-a944-33032ed55789 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:25.665025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:25.744463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f093ba-e787-4c3f-a944-33032ed55789 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:25.779117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157d172-680f-4ed8-aaec-ad6352260010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:25.779731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157d172-680f-4ed8-aaec-ad6352260010 None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:25.780023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157d172-680f-4ed8-aaec-ad6352260010 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:25.780298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157d172-680f-4ed8-aaec-ad6352260010 None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/7d8054e88916456991bf485c19f8b502/roles/692f6347c3684ae090a246e0ed558ef1` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:25.782460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157d172-680f-4ed8-aaec-ad6352260010 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=7d8054e88916456991bf485c19f8b502, role_id=692f6347c3684ae090a246e0ed558ef1)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:25.783963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157d172-680f-4ed8-aaec-ad6352260010 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:25.889428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 544/1079] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:37:25 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/7d8054e88916456991bf485c19f8b502/roles/692f6347c3684ae090a246e0ed558ef1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:37:25.891170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a732ad8-e087-45d8-95c7-9ee3e1b6f223 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:25.975912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:26.000290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a732ad8-e087-45d8-95c7-9ee3e1b6f223 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:26.038224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d595-1c01-4d3b-a4dd-f57e3ede37f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:26.038832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d595-1c01-4d3b-a4dd-f57e3ede37f5 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:26.039045 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d595-1c01-4d3b-a4dd-f57e3ede37f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:26.039356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d595-1c01-4d3b-a4dd-f57e3ede37f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:26.050435 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6d595-1c01-4d3b-a4dd-f57e3ede37f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-22f6d595-1c01-4d3b-a4dd-f57e3ede37f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:26.055641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:26.056745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:26.057598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 536/1080] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:26.062975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157d172-680f-4ed8-aaec-ad6352260010 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:26.140349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:26.161355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157d172-680f-4ed8-aaec-ad6352260010 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:26.196155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8590b34-4b02-4c34-9efb-6010a7a72364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:26.196766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590b34-4b02-4c34-9efb-6010a7a72364 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:26.197046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590b34-4b02-4c34-9efb-6010a7a72364 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:26.197328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590b34-4b02-4c34-9efb-6010a7a72364 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:26.197992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8590b34-4b02-4c34-9efb-6010a7a72364 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:26.198296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8590b34-4b02-4c34-9efb-6010a7a72364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:26.200325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8590b34-4b02-4c34-9efb-6010a7a72364 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:26.208667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 545/1081] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:37:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:26.214530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d595-1c01-4d3b-a4dd-f57e3ede37f5 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:26.319402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d595-1c01-4d3b-a4dd-f57e3ede37f5 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:26.353798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8537a-7a86-4297-9231-ab912b0efac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:26.354423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8537a-7a86-4297-9231-ab912b0efac9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:26.354697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8537a-7a86-4297-9231-ab912b0efac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:26.354962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8537a-7a86-4297-9231-ab912b0efac9 None admin] PATH_INFO: `/v3/users/7f5d738be88f45e5afba9da4f05e8672` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:26.356106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8537a-7a86-4297-9231-ab912b0efac9 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5d738be88f45e5afba9da4f05e8672)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:26.357537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8537a-7a86-4297-9231-ab912b0efac9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:26.359431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 537/1082] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:26 2022] GET /identity/v3/users/7f5d738be88f45e5afba9da4f05e8672 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:26.364961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8590b34-4b02-4c34-9efb-6010a7a72364 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:26.462434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8590b34-4b02-4c34-9efb-6010a7a72364 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:26.494835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebd1b9-77aa-433a-a920-30c1f6a750f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:26.495485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd1b9-77aa-433a-a920-30c1f6a750f2 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:26.495768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd1b9-77aa-433a-a920-30c1f6a750f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:26.496036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd1b9-77aa-433a-a920-30c1f6a750f2 None admin] PATH_INFO: `/v3/projects/2d887067d6454e989170f4ac0d2caf89` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:26.497735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebd1b9-77aa-433a-a920-30c1f6a750f2 None admin] RBAC: Authorizing `identity:get_project(project_id=2d887067d6454e989170f4ac0d2caf89)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:26.499153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebd1b9-77aa-433a-a920-30c1f6a750f2 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:26.500815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 546/1083] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:37:26 2022] GET /identity/v3/projects/2d887067d6454e989170f4ac0d2caf89 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:26.506748 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8537a-7a86-4297-9231-ab912b0efac9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:26.510754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:26.607988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8537a-7a86-4297-9231-ab912b0efac9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:26.640005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f071f1-a608-4fbf-8fb2-ad139226e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:26.640657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f071f1-a608-4fbf-8fb2-ad139226e3ce None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:26.640937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f071f1-a608-4fbf-8fb2-ad139226e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:26.641209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f071f1-a608-4fbf-8fb2-ad139226e3ce None admin] PATH_INFO: `/v3/projects/2d887067d6454e989170f4ac0d2caf89/users/7f5d738be88f45e5afba9da4f05e8672/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:26.643083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f071f1-a608-4fbf-8fb2-ad139226e3ce None admin] RBAC: Authorizing `identity:create_grant(project_id=2d887067d6454e989170f4ac0d2caf89, user_id=7f5d738be88f45e5afba9da4f05e8672, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:26.644539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f071f1-a608-4fbf-8fb2-ad139226e3ce None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:26.714999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 538/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:37:26 2022] PUT /identity/v3/projects/2d887067d6454e989170f4ac0d2caf89/users/7f5d738be88f45e5afba9da4f05e8672/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:37:27.790233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e037-9ea2-4cf3-8642-fa2f9a8268b2 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:27.790759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e037-9ea2-4cf3-8642-fa2f9a8268b2 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:27.790893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e037-9ea2-4cf3-8642-fa2f9a8268b2 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:27.792331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 547/1085] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:27.798126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a1fe9-c5c0-455c-8178-a5b331108885 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:27.798535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a1fe9-c5c0-455c-8178-a5b331108885 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:27.798912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a1fe9-c5c0-455c-8178-a5b331108885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:27.817248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d76a1fe9-c5c0-455c-8178-a5b331108885 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:27.818148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d76a1fe9-c5c0-455c-8178-a5b331108885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:27.884097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:27.893160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 539/1086] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:28.169912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e037-9ea2-4cf3-8642-fa2f9a8268b2 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:28.182302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:28.274519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e037-9ea2-4cf3-8642-fa2f9a8268b2 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:28.308817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ded82-07ee-4cc6-a58a-f84a2929f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:28.309638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ded82-07ee-4cc6-a58a-f84a2929f00c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:28.309924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ded82-07ee-4cc6-a58a-f84a2929f00c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:28.310197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ded82-07ee-4cc6-a58a-f84a2929f00c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:28.320672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ded82-07ee-4cc6-a58a-f84a2929f00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-0d2ded82-07ee-4cc6-a58a-f84a2929f00c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:28.325980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:28.327122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:28.328008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 548/1087] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 24 07:37:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:28.333036 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a1fe9-c5c0-455c-8178-a5b331108885 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:28.433537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a1fe9-c5c0-455c-8178-a5b331108885 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:28.466126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c42e5-a754-4571-b707-b103978c23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:28.466757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c42e5-a754-4571-b707-b103978c23b6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:28.467038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c42e5-a754-4571-b707-b103978c23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:28.467336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c42e5-a754-4571-b707-b103978c23b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:28.467990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c42e5-a754-4571-b707-b103978c23b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:28.468291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c42e5-a754-4571-b707-b103978c23b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:28.469648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c42e5-a754-4571-b707-b103978c23b6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:28.477572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 540/1088] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 07:37:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:28.483917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ded82-07ee-4cc6-a58a-f84a2929f00c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:28.549648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:28.582445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ded82-07ee-4cc6-a58a-f84a2929f00c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:28.615817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fa6e0-1c44-4a2b-97d7-42b3d13aa30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:28.616587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fa6e0-1c44-4a2b-97d7-42b3d13aa30c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:28.616870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fa6e0-1c44-4a2b-97d7-42b3d13aa30c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:28.617146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fa6e0-1c44-4a2b-97d7-42b3d13aa30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:28.617991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c8188-6161-4317-930b-9484986a97fb None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:28.618280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c8188-6161-4317-930b-9484986a97fb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:28.618611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c8188-6161-4317-930b-9484986a97fb None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:28.620484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 541/1089] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:28.626071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d72c1-fbea-4e79-9204-4618ddf7b64a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:28.626426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d72c1-fbea-4e79-9204-4618ddf7b64a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:28.626786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d72c1-fbea-4e79-9204-4618ddf7b64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:28.628534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fa6e0-1c44-4a2b-97d7-42b3d13aa30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:28.629959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fa6e0-1c44-4a2b-97d7-42b3d13aa30c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:28.644980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-055d72c1-fbea-4e79-9204-4618ddf7b64a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-1c0fa6e0-1c44-4a2b-97d7-42b3d13aa30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:28.645239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:28.646341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:28.647349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:28.647349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:28.647349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:28.647542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-055d72c1-fbea-4e79-9204-4618ddf7b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:28.647614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 549/1090] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:28.652167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fa6e0-1c44-4a2b-97d7-42b3d13aa30c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:28.697413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:28.714436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 542/1091] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:28.757065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fa6e0-1c44-4a2b-97d7-42b3d13aa30c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:28.777974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:28.791659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee9ad-41ec-4d61-b267-bd15e9f863f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:28.792264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee9ad-41ec-4d61-b267-bd15e9f863f9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:28.792602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee9ad-41ec-4d61-b267-bd15e9f863f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:28.792881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee9ad-41ec-4d61-b267-bd15e9f863f9 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:28.793598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eee9ad-41ec-4d61-b267-bd15e9f863f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:28.793897 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eee9ad-41ec-4d61-b267-bd15e9f863f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:28.795270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eee9ad-41ec-4d61-b267-bd15e9f863f9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:28.807079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 550/1092] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:28.813616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d72c1-fbea-4e79-9204-4618ddf7b64a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:28.910895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d72c1-fbea-4e79-9204-4618ddf7b64a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:28.943677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25caf01-5210-4a16-a1f2-e2720326289d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:28.944291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25caf01-5210-4a16-a1f2-e2720326289d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:28.944570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25caf01-5210-4a16-a1f2-e2720326289d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:28.944841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25caf01-5210-4a16-a1f2-e2720326289d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:28.952179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25caf01-5210-4a16-a1f2-e2720326289d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:28.953544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25caf01-5210-4a16-a1f2-e2720326289d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-f25caf01-5210-4a16-a1f2-e2720326289d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:37:28.964665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:28.965846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:28.966818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 543/1093] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 24 07:37:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:28.972124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee9ad-41ec-4d61-b267-bd15e9f863f9 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:28.989283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25caf01-5210-4a16-a1f2-e2720326289d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.037352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:29.072054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eee9ad-41ec-4d61-b267-bd15e9f863f9 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.092468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25caf01-5210-4a16-a1f2-e2720326289d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.110084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151a54f-4bb5-4a43-914d-5e0de1b2f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.110688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a54f-4bb5-4a43-914d-5e0de1b2f462 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.110966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a54f-4bb5-4a43-914d-5e0de1b2f462 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.111243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a54f-4bb5-4a43-914d-5e0de1b2f462 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.111999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151a54f-4bb5-4a43-914d-5e0de1b2f462 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:29.112304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151a54f-4bb5-4a43-914d-5e0de1b2f462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:29.113728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151a54f-4bb5-4a43-914d-5e0de1b2f462 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:29.125634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0244bca-c459-4257-a6b7-ad2c713dedf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.126245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0244bca-c459-4257-a6b7-ad2c713dedf1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.126518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0244bca-c459-4257-a6b7-ad2c713dedf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.126788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0244bca-c459-4257-a6b7-ad2c713dedf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.131421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 551/1094] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 24 07:37:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:29.138168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151a54f-4bb5-4a43-914d-5e0de1b2f462 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.138303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0244bca-c459-4257-a6b7-ad2c713dedf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-e0244bca-c459-4257-a6b7-ad2c713dedf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:29.142832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:29.144015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:29.144872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 544/1095] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:37:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:29.149656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0244bca-c459-4257-a6b7-ad2c713dedf1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.179111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:29.239478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151a54f-4bb5-4a43-914d-5e0de1b2f462 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.247957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0244bca-c459-4257-a6b7-ad2c713dedf1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.254758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:29.274131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40739e-04a3-437c-86c1-1120e7dd4b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.274733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40739e-04a3-437c-86c1-1120e7dd4b67 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.275013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40739e-04a3-437c-86c1-1120e7dd4b67 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.275280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40739e-04a3-437c-86c1-1120e7dd4b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.282603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c58d9-8437-499c-9cda-ba6897b08be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.283389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c58d9-8437-499c-9cda-ba6897b08be8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.283931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c58d9-8437-499c-9cda-ba6897b08be8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.284210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c58d9-8437-499c-9cda-ba6897b08be8 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.284869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c58d9-8437-499c-9cda-ba6897b08be8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:29.285173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c58d9-8437-499c-9cda-ba6897b08be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:29.286536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c58d9-8437-499c-9cda-ba6897b08be8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:29.295154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 545/1096] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:29.301278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c58d9-8437-499c-9cda-ba6897b08be8 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.347187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40739e-04a3-437c-86c1-1120e7dd4b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:29.348723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40739e-04a3-437c-86c1-1120e7dd4b67 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:29.387705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:29.405735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c58d9-8437-499c-9cda-ba6897b08be8 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.441031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2076c-446d-4a8c-a742-1cc84d5c3aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.441658 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2076c-446d-4a8c-a742-1cc84d5c3aed None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.441946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2076c-446d-4a8c-a742-1cc84d5c3aed None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.442233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2076c-446d-4a8c-a742-1cc84d5c3aed None admin] PATH_INFO: `/v3/users/7f5d738be88f45e5afba9da4f05e8672` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.443374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2076c-446d-4a8c-a742-1cc84d5c3aed None admin] RBAC: Authorizing `identity:get_user(user_id=7f5d738be88f45e5afba9da4f05e8672)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:29.444795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2076c-446d-4a8c-a742-1cc84d5c3aed None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:29.446543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 546/1097] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/users/7f5d738be88f45e5afba9da4f05e8672 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:29.451339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 552/1098] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:37:29.453207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2076c-446d-4a8c-a742-1cc84d5c3aed None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.454757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40739e-04a3-437c-86c1-1120e7dd4b67 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.488539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:29.551438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40739e-04a3-437c-86c1-1120e7dd4b67 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.555313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2076c-446d-4a8c-a742-1cc84d5c3aed None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.586553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25add6dd-8417-4d8a-a949-0e3005e04167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.587169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25add6dd-8417-4d8a-a949-0e3005e04167 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.587472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25add6dd-8417-4d8a-a949-0e3005e04167 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.587743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25add6dd-8417-4d8a-a949-0e3005e04167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.591372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e581610-2873-4d1e-b516-b59e87f66ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.591982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e581610-2873-4d1e-b516-b59e87f66ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.592262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e581610-2873-4d1e-b516-b59e87f66ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.592533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e581610-2873-4d1e-b516-b59e87f66ac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.594661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:29.598408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25add6dd-8417-4d8a-a949-0e3005e04167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:29.599883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25add6dd-8417-4d8a-a949-0e3005e04167 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-25add6dd-8417-4d8a-a949-0e3005e04167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:29.615158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:29.616264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:37:29.617151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:29.617151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:37:29.617151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:29.617151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 553/1099] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:37:29.622731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25add6dd-8417-4d8a-a949-0e3005e04167 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.662412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e581610-2873-4d1e-b516-b59e87f66ac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:29.663892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e581610-2873-4d1e-b516-b59e87f66ac0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:29.696960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:29.721158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25add6dd-8417-4d8a-a949-0e3005e04167 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.754194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ad503-4965-4970-a45b-1db6801bb0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.754796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ad503-4965-4970-a45b-1db6801bb0ac None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.755078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ad503-4965-4970-a45b-1db6801bb0ac None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.755380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ad503-4965-4970-a45b-1db6801bb0ac None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.756023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ad503-4965-4970-a45b-1db6801bb0ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:29.756324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ad503-4965-4970-a45b-1db6801bb0ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:29.757684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ad503-4965-4970-a45b-1db6801bb0ac None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:29.761595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 547/1100] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:37:29.768251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e581610-2873-4d1e-b516-b59e87f66ac0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.774514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 554/1101] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:29.775512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ad503-4965-4970-a45b-1db6801bb0ac None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.824480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:29.867237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e581610-2873-4d1e-b516-b59e87f66ac0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.873588 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ad503-4965-4970-a45b-1db6801bb0ac None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:29.900947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fc8e6-defe-4807-af0d-e39399ba2849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.901560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fc8e6-defe-4807-af0d-e39399ba2849 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.901840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fc8e6-defe-4807-af0d-e39399ba2849 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.902125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fc8e6-defe-4807-af0d-e39399ba2849 None admin] PATH_INFO: `/v3/projects/2d887067d6454e989170f4ac0d2caf89` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.903372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fc8e6-defe-4807-af0d-e39399ba2849 None admin] RBAC: Authorizing `identity:get_project(project_id=2d887067d6454e989170f4ac0d2caf89)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:29.904787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fc8e6-defe-4807-af0d-e39399ba2849 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:29.906423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 548/1102] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/projects/2d887067d6454e989170f4ac0d2caf89 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:29.907893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c97b8-131a-4238-bc26-45c6039c2ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:29.908531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c97b8-131a-4238-bc26-45c6039c2ca0 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:29.908821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c97b8-131a-4238-bc26-45c6039c2ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:29.909103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c97b8-131a-4238-bc26-45c6039c2ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:29.912327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fc8e6-defe-4807-af0d-e39399ba2849 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:29.915667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:29.916863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c97b8-131a-4238-bc26-45c6039c2ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:29.918818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c97b8-131a-4238-bc26-45c6039c2ca0 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-ae3c97b8-131a-4238-bc26-45c6039c2ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:37:29.930332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:29.931496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:29.932757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:37:29.932757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:37:29.932757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:37:29.932757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:37:29.932757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:37:29.932757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:37:29.932757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:37:29.932757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:29.932757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 555/1103] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:29.937311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c97b8-131a-4238-bc26-45c6039c2ca0 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:30.015510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fc8e6-defe-4807-af0d-e39399ba2849 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:30.035276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c97b8-131a-4238-bc26-45c6039c2ca0 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:30.046309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:30.048789 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618049-d1c8-41eb-97fe-8175bfbd9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:30.049385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618049-d1c8-41eb-97fe-8175bfbd9e86 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:30.049661 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618049-d1c8-41eb-97fe-8175bfbd9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:30.049928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618049-d1c8-41eb-97fe-8175bfbd9e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:30.050637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87618049-d1c8-41eb-97fe-8175bfbd9e86 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=2d887067d6454e989170f4ac0d2caf89, user.id=7f5d738be88f45e5afba9da4f05e8672) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:30.050937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87618049-d1c8-41eb-97fe-8175bfbd9e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:30.052400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87618049-d1c8-41eb-97fe-8175bfbd9e86 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:30.057962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 549/1104] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/role_assignments?user.id=7f5d738be88f45e5afba9da4f05e8672&scope.project.id=2d887067d6454e989170f4ac0d2caf89&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:30.070716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bb772-bbce-4134-845d-d14ab0b7291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:30.071389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb772-bbce-4134-845d-d14ab0b7291f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:30.071675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb772-bbce-4134-845d-d14ab0b7291f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:30.071948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb772-bbce-4134-845d-d14ab0b7291f None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:30.072659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bb772-bbce-4134-845d-d14ab0b7291f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:30.072971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bb772-bbce-4134-845d-d14ab0b7291f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:30.074603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bb772-bbce-4134-845d-d14ab0b7291f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:30.088240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 556/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:30.094563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618049-d1c8-41eb-97fe-8175bfbd9e86 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:30.164444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:30.200620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618049-d1c8-41eb-97fe-8175bfbd9e86 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:30.240158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd9353-f495-4c2f-8759-865c0b1b31c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:30.240769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd9353-f495-4c2f-8759-865c0b1b31c7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:30.241051 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd9353-f495-4c2f-8759-865c0b1b31c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:30.241329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd9353-f495-4c2f-8759-865c0b1b31c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:30.242047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd9353-f495-4c2f-8759-865c0b1b31c7 None admin] RBAC: Adding query filter params (role.id=692f6347c3684ae090a246e0ed558ef1, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=7d8054e88916456991bf485c19f8b502) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:30.242357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd9353-f495-4c2f-8759-865c0b1b31c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:30.243842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd9353-f495-4c2f-8759-865c0b1b31c7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:30.249680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 550/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:37:30 2022] GET /identity/v3/role_assignments?user.id=7d8054e88916456991bf485c19f8b502&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=692f6347c3684ae090a246e0ed558ef1 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:32.017728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314e7eb-92c7-4a66-a3b5-ed0a99feab94 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:32.018260 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314e7eb-92c7-4a66-a3b5-ed0a99feab94 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:32.018260 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314e7eb-92c7-4a66-a3b5-ed0a99feab94 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:32.019658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 557/1107] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:32.024886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605dda0-1131-4b8e-ba47-ca0b70fa49a7 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:32.025305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605dda0-1131-4b8e-ba47-ca0b70fa49a7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:32.025436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605dda0-1131-4b8e-ba47-ca0b70fa49a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:32.044239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2605dda0-1131-4b8e-ba47-ca0b70fa49a7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:32.045417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2605dda0-1131-4b8e-ba47-ca0b70fa49a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:32.110674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 551/1108] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:32.375064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314e7eb-92c7-4a66-a3b5-ed0a99feab94 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:32.475842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314e7eb-92c7-4a66-a3b5-ed0a99feab94 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:32.508348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39687c-81a1-4b69-be91-57681c6bd1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:32.508960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39687c-81a1-4b69-be91-57681c6bd1be None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:32.509233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39687c-81a1-4b69-be91-57681c6bd1be None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:32.509499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39687c-81a1-4b69-be91-57681c6bd1be None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:32.510584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39687c-81a1-4b69-be91-57681c6bd1be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:32.512757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39687c-81a1-4b69-be91-57681c6bd1be None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:32.514297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 558/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:32.520194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605dda0-1131-4b8e-ba47-ca0b70fa49a7 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:32.580019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:32.625387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605dda0-1131-4b8e-ba47-ca0b70fa49a7 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:32.660674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4c32-b7e7-4e0e-af63-3eda154adcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:32.661270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4c32-b7e7-4e0e-af63-3eda154adcde None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:32.661550 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4c32-b7e7-4e0e-af63-3eda154adcde None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:32.661831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4c32-b7e7-4e0e-af63-3eda154adcde None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:32.662477 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4c32-b7e7-4e0e-af63-3eda154adcde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:32.663938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4c32-b7e7-4e0e-af63-3eda154adcde None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:32.755015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 552/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:37:32 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:37:34.754221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6e5d-01a7-46cf-8884-063f2e2a7ef4 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:34.754759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6e5d-01a7-46cf-8884-063f2e2a7ef4 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:34.754759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6e5d-01a7-46cf-8884-063f2e2a7ef4 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:34.756147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 559/1111] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:34.761269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e674120-b69f-498a-bd42-3210a4610bd5 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:34.762286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e674120-b69f-498a-bd42-3210a4610bd5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:34.762377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e674120-b69f-498a-bd42-3210a4610bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:34.780060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3e674120-b69f-498a-bd42-3210a4610bd5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:34.781238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3e674120-b69f-498a-bd42-3210a4610bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:34.846747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 553/1112] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:35.120195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6e5d-01a7-46cf-8884-063f2e2a7ef4 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:35.162561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:35.223069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6e5d-01a7-46cf-8884-063f2e2a7ef4 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:35.256777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30668ff4-2fea-4b5b-92ba-1bb651092ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:35.257392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30668ff4-2fea-4b5b-92ba-1bb651092ec2 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:35.257676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30668ff4-2fea-4b5b-92ba-1bb651092ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:35.258000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30668ff4-2fea-4b5b-92ba-1bb651092ec2 None admin] PATH_INFO: `/v3/roles/b1bfc74339e44fc983bfb20cbf2bda25` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:35.259463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30668ff4-2fea-4b5b-92ba-1bb651092ec2 None admin] RBAC: Authorizing `identity:get_role(role_id=b1bfc74339e44fc983bfb20cbf2bda25)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:35.260831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30668ff4-2fea-4b5b-92ba-1bb651092ec2 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:35.262655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 560/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:35 2022] GET /identity/v3/roles/b1bfc74339e44fc983bfb20cbf2bda25 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:35.268483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e674120-b69f-498a-bd42-3210a4610bd5 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:35.317527 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:35.368770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e674120-b69f-498a-bd42-3210a4610bd5 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:35.401965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665eef-60a9-4a94-afdf-8c5b3a1a9f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:35.403332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665eef-60a9-4a94-afdf-8c5b3a1a9f73 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:35.403615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665eef-60a9-4a94-afdf-8c5b3a1a9f73 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:35.403884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665eef-60a9-4a94-afdf-8c5b3a1a9f73 None admin] PATH_INFO: `/v3/users/e466d2c7e8ec454d94044b46f5f8acb6` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:35.416342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665eef-60a9-4a94-afdf-8c5b3a1a9f73 None admin] RBAC: Authorizing `identity:get_user(user_id=e466d2c7e8ec454d94044b46f5f8acb6)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:35.417967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665eef-60a9-4a94-afdf-8c5b3a1a9f73 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:35.419570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 554/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:35 2022] GET /identity/v3/users/e466d2c7e8ec454d94044b46f5f8acb6 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:35.425649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30668ff4-2fea-4b5b-92ba-1bb651092ec2 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:35.522267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30668ff4-2fea-4b5b-92ba-1bb651092ec2 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:35.529504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:35.555052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55f75-eb06-419e-8381-b2fa95683d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:35.555677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55f75-eb06-419e-8381-b2fa95683d0f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:35.555956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55f75-eb06-419e-8381-b2fa95683d0f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:35.556228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55f75-eb06-419e-8381-b2fa95683d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:35.626786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55f75-eb06-419e-8381-b2fa95683d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:35.628263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55f75-eb06-419e-8381-b2fa95683d0f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:35.723120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 561/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:37:35.729003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665eef-60a9-4a94-afdf-8c5b3a1a9f73 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:35.825796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665eef-60a9-4a94-afdf-8c5b3a1a9f73 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:35.832926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:35.859425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24657452-2209-4c08-a207-a4825bd933a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:35.860049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657452-2209-4c08-a207-a4825bd933a5 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:35.860386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657452-2209-4c08-a207-a4825bd933a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:35.860671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24657452-2209-4c08-a207-a4825bd933a5 None admin] PATH_INFO: `/v3/projects/2d887067d6454e989170f4ac0d2caf89` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:35.861780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24657452-2209-4c08-a207-a4825bd933a5 None admin] RBAC: Authorizing `identity:get_project(project_id=2d887067d6454e989170f4ac0d2caf89)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:35.863209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24657452-2209-4c08-a207-a4825bd933a5 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:35.865074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 555/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:37:35 2022] GET /identity/v3/projects/2d887067d6454e989170f4ac0d2caf89 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:35.871321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55f75-eb06-419e-8381-b2fa95683d0f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:35.879914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:35.967696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55f75-eb06-419e-8381-b2fa95683d0f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:36.001199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ed9b4-5d53-4a17-962a-fb9c508c1169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:36.001793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed9b4-5d53-4a17-962a-fb9c508c1169 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:36.002073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed9b4-5d53-4a17-962a-fb9c508c1169 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:36.002347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed9b4-5d53-4a17-962a-fb9c508c1169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:36.003061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed9b4-5d53-4a17-962a-fb9c508c1169 None admin] RBAC: Adding query filter params (role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=2d887067d6454e989170f4ac0d2caf89, user.id=e466d2c7e8ec454d94044b46f5f8acb6) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:36.003399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed9b4-5d53-4a17-962a-fb9c508c1169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:36.004820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed9b4-5d53-4a17-962a-fb9c508c1169 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:36.010049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 562/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:37:35 2022] GET /identity/v3/role_assignments?user.id=e466d2c7e8ec454d94044b46f5f8acb6&scope.project.id=2d887067d6454e989170f4ac0d2caf89&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:37.885487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac5ea8-0c92-40de-aa6c-889c27106e1e None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:37.886039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac5ea8-0c92-40de-aa6c-889c27106e1e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:37.886039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac5ea8-0c92-40de-aa6c-889c27106e1e None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:37.887463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 556/1118] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:37.892473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b032a-8aaf-4fda-bb9c-79ab3cebf48c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:37.892894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b032a-8aaf-4fda-bb9c-79ab3cebf48c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:37.893033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b032a-8aaf-4fda-bb9c-79ab3cebf48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:37.911271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c66b032a-8aaf-4fda-bb9c-79ab3cebf48c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:37.912474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c66b032a-8aaf-4fda-bb9c-79ab3cebf48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:37.973957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:37.978324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 563/1119] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:38.246094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac5ea8-0c92-40de-aa6c-889c27106e1e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:38.345094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac5ea8-0c92-40de-aa6c-889c27106e1e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:38.379459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32314059-127b-4fdc-a29f-fc644e28801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:38.380073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32314059-127b-4fdc-a29f-fc644e28801b None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:38.380346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32314059-127b-4fdc-a29f-fc644e28801b None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:38.380612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32314059-127b-4fdc-a29f-fc644e28801b None admin] PATH_INFO: `/v3/roles/b1bfc74339e44fc983bfb20cbf2bda25` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:38.381973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32314059-127b-4fdc-a29f-fc644e28801b None admin] RBAC: Authorizing `identity:get_role(role_id=b1bfc74339e44fc983bfb20cbf2bda25)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:38.383327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32314059-127b-4fdc-a29f-fc644e28801b None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:38.384621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 557/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:38 2022] GET /identity/v3/roles/b1bfc74339e44fc983bfb20cbf2bda25 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:38.391020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b032a-8aaf-4fda-bb9c-79ab3cebf48c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:38.488949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b032a-8aaf-4fda-bb9c-79ab3cebf48c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:38.522971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdc932-805b-41e3-bb2f-f19bac261dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:38.523565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdc932-805b-41e3-bb2f-f19bac261dd3 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:38.523848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdc932-805b-41e3-bb2f-f19bac261dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:38.524122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdc932-805b-41e3-bb2f-f19bac261dd3 None admin] PATH_INFO: `/v3/users/e466d2c7e8ec454d94044b46f5f8acb6` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:38.525239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdc932-805b-41e3-bb2f-f19bac261dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=e466d2c7e8ec454d94044b46f5f8acb6)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:38.527189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdc932-805b-41e3-bb2f-f19bac261dd3 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:38.529010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 564/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:38 2022] GET /identity/v3/users/e466d2c7e8ec454d94044b46f5f8acb6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:38.534756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32314059-127b-4fdc-a29f-fc644e28801b None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:38.576707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:38.630643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32314059-127b-4fdc-a29f-fc644e28801b None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:38.667770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6de608-134b-4434-a20b-402d363c084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:38.668376 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6de608-134b-4434-a20b-402d363c084c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:38.668650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6de608-134b-4434-a20b-402d363c084c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:38.668915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6de608-134b-4434-a20b-402d363c084c None admin] PATH_INFO: `/v3/projects/2d887067d6454e989170f4ac0d2caf89` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:38.669993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6de608-134b-4434-a20b-402d363c084c None admin] RBAC: Authorizing `identity:get_project(project_id=2d887067d6454e989170f4ac0d2caf89)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:38.671424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6de608-134b-4434-a20b-402d363c084c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:38.673026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 558/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:37:38 2022] GET /identity/v3/projects/2d887067d6454e989170f4ac0d2caf89 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:38.679275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdc932-805b-41e3-bb2f-f19bac261dd3 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:38.744130 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:38.777593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdc932-805b-41e3-bb2f-f19bac261dd3 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:38.811471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5953d-a429-4e01-81cb-51472d211b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:38.812141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5953d-a429-4e01-81cb-51472d211b9a None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:38.812432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5953d-a429-4e01-81cb-51472d211b9a None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:38.812715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5953d-a429-4e01-81cb-51472d211b9a None admin] PATH_INFO: `/v3/projects/2d887067d6454e989170f4ac0d2caf89/users/e466d2c7e8ec454d94044b46f5f8acb6/roles/b1bfc74339e44fc983bfb20cbf2bda25` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:38.814818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5953d-a429-4e01-81cb-51472d211b9a None admin] RBAC: Authorizing `identity:create_grant(project_id=2d887067d6454e989170f4ac0d2caf89, user_id=e466d2c7e8ec454d94044b46f5f8acb6, role_id=b1bfc74339e44fc983bfb20cbf2bda25)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:38.816294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5953d-a429-4e01-81cb-51472d211b9a None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:38.892997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 565/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:37:38 2022] PUT /identity/v3/projects/2d887067d6454e989170f4ac0d2caf89/users/e466d2c7e8ec454d94044b46f5f8acb6/roles/b1bfc74339e44fc983bfb20cbf2bda25 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:37:40.791539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ee578-13ea-4453-bd4e-6f899b3324f3 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:40.792081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ee578-13ea-4453-bd4e-6f899b3324f3 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:40.792236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ee578-13ea-4453-bd4e-6f899b3324f3 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:40.794013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 559/1124] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:40.799558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731e969-c919-402f-a51b-83acb540445d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:40.800002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731e969-c919-402f-a51b-83acb540445d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:40.800108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731e969-c919-402f-a51b-83acb540445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:40.817680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a731e969-c919-402f-a51b-83acb540445d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:40.818844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a731e969-c919-402f-a51b-83acb540445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:40.884144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 566/1125] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:41.162162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ee578-13ea-4453-bd4e-6f899b3324f3 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:41.260610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ee578-13ea-4453-bd4e-6f899b3324f3 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:41.271448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:41.294725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda05a91-3815-4b11-b600-5dcd5fd25f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:41.295368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda05a91-3815-4b11-b600-5dcd5fd25f53 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:41.295653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda05a91-3815-4b11-b600-5dcd5fd25f53 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:41.295950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda05a91-3815-4b11-b600-5dcd5fd25f53 None admin] PATH_INFO: `/v3/roles/b1bfc74339e44fc983bfb20cbf2bda25` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:41.297426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda05a91-3815-4b11-b600-5dcd5fd25f53 None admin] RBAC: Authorizing `identity:get_role(role_id=b1bfc74339e44fc983bfb20cbf2bda25)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:41.299390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda05a91-3815-4b11-b600-5dcd5fd25f53 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:41.300965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 560/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:41 2022] GET /identity/v3/roles/b1bfc74339e44fc983bfb20cbf2bda25 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:41.306862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731e969-c919-402f-a51b-83acb540445d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:41.363413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:41.404479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731e969-c919-402f-a51b-83acb540445d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:41.438912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2164d-c4bb-4cb9-928f-6d72af539b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:41.439506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2164d-c4bb-4cb9-928f-6d72af539b73 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:41.439791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2164d-c4bb-4cb9-928f-6d72af539b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:41.440070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2164d-c4bb-4cb9-928f-6d72af539b73 None admin] PATH_INFO: `/v3/users/e466d2c7e8ec454d94044b46f5f8acb6` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:41.441191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2164d-c4bb-4cb9-928f-6d72af539b73 None admin] RBAC: Authorizing `identity:get_user(user_id=e466d2c7e8ec454d94044b46f5f8acb6)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:41.442630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2164d-c4bb-4cb9-928f-6d72af539b73 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:41.444241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 567/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:41 2022] GET /identity/v3/users/e466d2c7e8ec454d94044b46f5f8acb6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:41.451329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda05a91-3815-4b11-b600-5dcd5fd25f53 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:41.545883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda05a91-3815-4b11-b600-5dcd5fd25f53 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:41.581087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d00db-af18-48ed-8a05-6121b1242693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:41.581686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d00db-af18-48ed-8a05-6121b1242693 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:41.581967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d00db-af18-48ed-8a05-6121b1242693 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:41.582241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d00db-af18-48ed-8a05-6121b1242693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:41.628066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:41.649107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d00db-af18-48ed-8a05-6121b1242693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:41.650598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d00db-af18-48ed-8a05-6121b1242693 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:41.746976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 561/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:37:41.753074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2164d-c4bb-4cb9-928f-6d72af539b73 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:41.850474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2164d-c4bb-4cb9-928f-6d72af539b73 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:41.875042 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:41.883381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c76320-ae93-4793-93d6-047e47d31ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:41.884325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c76320-ae93-4793-93d6-047e47d31ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:41.884325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c76320-ae93-4793-93d6-047e47d31ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:41.884576 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c76320-ae93-4793-93d6-047e47d31ae5 None admin] PATH_INFO: `/v3/projects/2d887067d6454e989170f4ac0d2caf89` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:41.886181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c76320-ae93-4793-93d6-047e47d31ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=2d887067d6454e989170f4ac0d2caf89)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:41.887791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c76320-ae93-4793-93d6-047e47d31ae5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:41.889410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 568/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:37:41 2022] GET /identity/v3/projects/2d887067d6454e989170f4ac0d2caf89 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:41.895605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d00db-af18-48ed-8a05-6121b1242693 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:41.972360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:41.992981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d00db-af18-48ed-8a05-6121b1242693 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:42.026963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b529b-1350-4c25-af06-6f32be06de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:42.027601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b529b-1350-4c25-af06-6f32be06de74 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:42.027884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b529b-1350-4c25-af06-6f32be06de74 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:42.028157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b529b-1350-4c25-af06-6f32be06de74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:42.028870 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b529b-1350-4c25-af06-6f32be06de74 None admin] RBAC: Adding query filter params (role.id=b1bfc74339e44fc983bfb20cbf2bda25, scope.project.id=2d887067d6454e989170f4ac0d2caf89, user.id=e466d2c7e8ec454d94044b46f5f8acb6) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:42.029178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b529b-1350-4c25-af06-6f32be06de74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:42.030594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b529b-1350-4c25-af06-6f32be06de74 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:42.036210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 562/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:37:41 2022] GET /identity/v3/role_assignments?user.id=e466d2c7e8ec454d94044b46f5f8acb6&scope.project.id=2d887067d6454e989170f4ac0d2caf89&role.id=b1bfc74339e44fc983bfb20cbf2bda25 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:43.996295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c7c0a-cbd2-45f7-b3f6-a7d14fe58181 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:43.996820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c7c0a-cbd2-45f7-b3f6-a7d14fe58181 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:43.996820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c7c0a-cbd2-45f7-b3f6-a7d14fe58181 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:43.998186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 569/1131] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:37:44.003395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04f1c-4a8b-4d89-a851-818238b089b9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:44.003806 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04f1c-4a8b-4d89-a851-818238b089b9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:44.003943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f04f1c-4a8b-4d89-a851-818238b089b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:44.022771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f9f04f1c-4a8b-4d89-a851-818238b089b9 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:44.023966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f9f04f1c-4a8b-4d89-a851-818238b089b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:44.088248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 563/1132] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:37:44.361147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c7c0a-cbd2-45f7-b3f6-a7d14fe58181 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:44.460563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c7c0a-cbd2-45f7-b3f6-a7d14fe58181 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:44.494272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c3a42-e0e2-45eb-a7d8-e79f7cd91695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:44.495073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c3a42-e0e2-45eb-a7d8-e79f7cd91695 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:44.495397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c3a42-e0e2-45eb-a7d8-e79f7cd91695 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:44.495685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c3a42-e0e2-45eb-a7d8-e79f7cd91695 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:44.496800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c3a42-e0e2-45eb-a7d8-e79f7cd91695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:44.498283 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c3a42-e0e2-45eb-a7d8-e79f7cd91695 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:44.499832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 570/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:44.505564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04f1c-4a8b-4d89-a851-818238b089b9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:44.572448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:44.610511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f04f1c-4a8b-4d89-a851-818238b089b9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:44.643264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb1f6c-3c8d-4c58-958a-2042b3a23738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:44.643891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb1f6c-3c8d-4c58-958a-2042b3a23738 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:44.644176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb1f6c-3c8d-4c58-958a-2042b3a23738 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:44.644473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb1f6c-3c8d-4c58-958a-2042b3a23738 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:44.645119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb1f6c-3c8d-4c58-958a-2042b3a23738 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:44.646570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb1f6c-3c8d-4c58-958a-2042b3a23738 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:44.728592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 564/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:37:44 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:46.662202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff7811-0dc6-4adf-8c7f-6b31d121d69b None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:46.662715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff7811-0dc6-4adf-8c7f-6b31d121d69b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:46.662715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff7811-0dc6-4adf-8c7f-6b31d121d69b None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:46.664047 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 571/1135] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:46.669944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3745b4-4a6c-4e17-8359-b83d68499f21 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:46.670357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3745b4-4a6c-4e17-8359-b83d68499f21 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:46.670489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3745b4-4a6c-4e17-8359-b83d68499f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:46.688749 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-6c3745b4-4a6c-4e17-8359-b83d68499f21 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:46.689957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6c3745b4-4a6c-4e17-8359-b83d68499f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:46.753869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 565/1136] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:47.022498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff7811-0dc6-4adf-8c7f-6b31d121d69b None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:47.085965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:47.124923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff7811-0dc6-4adf-8c7f-6b31d121d69b None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:47.160318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f552be-1d82-45ad-8d22-3fe0215c9f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:47.160942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f552be-1d82-45ad-8d22-3fe0215c9f96 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:47.161219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f552be-1d82-45ad-8d22-3fe0215c9f96 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:47.161496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f552be-1d82-45ad-8d22-3fe0215c9f96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:47.162603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f552be-1d82-45ad-8d22-3fe0215c9f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:47.164072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f552be-1d82-45ad-8d22-3fe0215c9f96 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:47.165627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 572/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:37:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:47.171504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3745b4-4a6c-4e17-8359-b83d68499f21 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:47.225578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:47.270360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3745b4-4a6c-4e17-8359-b83d68499f21 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:47.304918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168a697-8820-41c1-841f-d0f73eb4a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:47.305452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a697-8820-41c1-841f-d0f73eb4a0ee None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:47.305732 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a697-8820-41c1-841f-d0f73eb4a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:47.306005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a697-8820-41c1-841f-d0f73eb4a0ee None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:47.306634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168a697-8820-41c1-841f-d0f73eb4a0ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:47.308687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168a697-8820-41c1-841f-d0f73eb4a0ee None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:47.396236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 566/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:37:47 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:37:49.318363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d24044-041d-4579-8466-a8c41f813455 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:49.318889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d24044-041d-4579-8466-a8c41f813455 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:49.318889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d24044-041d-4579-8466-a8c41f813455 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:49.320417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 573/1139] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:49.326048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4a87c-056d-49ff-aaa9-ebd083128f4f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:49.326418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4a87c-056d-49ff-aaa9-ebd083128f4f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:49.326598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4a87c-056d-49ff-aaa9-ebd083128f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:49.344924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-efa4a87c-056d-49ff-aaa9-ebd083128f4f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:49.346089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-efa4a87c-056d-49ff-aaa9-ebd083128f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:49.410601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 567/1140] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:49.678862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d24044-041d-4579-8466-a8c41f813455 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:49.778302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d24044-041d-4579-8466-a8c41f813455 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:49.805890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:49.811351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe8d13-6b99-4b88-a10b-0e577988c589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:49.811970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe8d13-6b99-4b88-a10b-0e577988c589 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:49.812250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe8d13-6b99-4b88-a10b-0e577988c589 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:49.812523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe8d13-6b99-4b88-a10b-0e577988c589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:49.822129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe8d13-6b99-4b88-a10b-0e577988c589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-23fe8d13-6b99-4b88-a10b-0e577988c589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:49.827057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:49.828264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:49.829410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 574/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:49.834239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4a87c-056d-49ff-aaa9-ebd083128f4f None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:49.874920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:49.930846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4a87c-056d-49ff-aaa9-ebd083128f4f None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:49.965472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51498b2c-d68e-4f45-bba8-d55d18b7a4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:49.966072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51498b2c-d68e-4f45-bba8-d55d18b7a4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:49.966354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51498b2c-d68e-4f45-bba8-d55d18b7a4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:49.966629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51498b2c-d68e-4f45-bba8-d55d18b7a4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:49.967309 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51498b2c-d68e-4f45-bba8-d55d18b7a4b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:49.967626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51498b2c-d68e-4f45-bba8-d55d18b7a4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:49.968993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51498b2c-d68e-4f45-bba8-d55d18b7a4b3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:49.976949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 568/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:49.983910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe8d13-6b99-4b88-a10b-0e577988c589 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:50.082726 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe8d13-6b99-4b88-a10b-0e577988c589 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:50.116266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8147de-7c24-4398-9c6b-6a02eb5e0650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:50.116881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8147de-7c24-4398-9c6b-6a02eb5e0650 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:50.117165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8147de-7c24-4398-9c6b-6a02eb5e0650 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:50.117440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8147de-7c24-4398-9c6b-6a02eb5e0650 None admin] PATH_INFO: `/v3/users/8c064e5a2bd541bfbd7bc8f907eb0c6b` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:50.130587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8147de-7c24-4398-9c6b-6a02eb5e0650 None admin] RBAC: Authorizing `identity:get_user(user_id=8c064e5a2bd541bfbd7bc8f907eb0c6b)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:50.132107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8147de-7c24-4398-9c6b-6a02eb5e0650 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:50.133685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 575/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:49 2022] GET /identity/v3/users/8c064e5a2bd541bfbd7bc8f907eb0c6b => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:50.140105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51498b2c-d68e-4f45-bba8-d55d18b7a4b3 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:50.237496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51498b2c-d68e-4f45-bba8-d55d18b7a4b3 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:50.238992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:50.271221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bd591-94a2-40ca-923e-3269c0512aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:50.271852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bd591-94a2-40ca-923e-3269c0512aad None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:50.272134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bd591-94a2-40ca-923e-3269c0512aad None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:50.272405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bd591-94a2-40ca-923e-3269c0512aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:50.337838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bd591-94a2-40ca-923e-3269c0512aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:50.340083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bd591-94a2-40ca-923e-3269c0512aad None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:50.437159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 569/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:37:50.443261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8147de-7c24-4398-9c6b-6a02eb5e0650 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:50.491049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:50.539753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8147de-7c24-4398-9c6b-6a02eb5e0650 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:50.573659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4dda2-605e-4b19-bc78-76fb6d0c38d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:50.574277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4dda2-605e-4b19-bc78-76fb6d0c38d1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:50.574567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4dda2-605e-4b19-bc78-76fb6d0c38d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:50.574840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4dda2-605e-4b19-bc78-76fb6d0c38d1 None admin] PATH_INFO: `/v3/projects/e6f4dff019ce498a83a657e99d361977` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:50.575967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4dda2-605e-4b19-bc78-76fb6d0c38d1 None admin] RBAC: Authorizing `identity:get_project(project_id=e6f4dff019ce498a83a657e99d361977)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:50.577392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4dda2-605e-4b19-bc78-76fb6d0c38d1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:50.578995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 576/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:37:50 2022] GET /identity/v3/projects/e6f4dff019ce498a83a657e99d361977 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:50.585115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bd591-94a2-40ca-923e-3269c0512aad None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:50.587231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:50.683552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bd591-94a2-40ca-923e-3269c0512aad None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:50.717916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac124fa4-6b27-40c6-bd75-ee06338e1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:50.718507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac124fa4-6b27-40c6-bd75-ee06338e1507 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:50.718790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac124fa4-6b27-40c6-bd75-ee06338e1507 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:50.719065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac124fa4-6b27-40c6-bd75-ee06338e1507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:50.719811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac124fa4-6b27-40c6-bd75-ee06338e1507 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=e6f4dff019ce498a83a657e99d361977, user.id=8c064e5a2bd541bfbd7bc8f907eb0c6b) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:50.720122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac124fa4-6b27-40c6-bd75-ee06338e1507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:50.721541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac124fa4-6b27-40c6-bd75-ee06338e1507 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:50.726771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 570/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:37:50 2022] GET /identity/v3/role_assignments?user.id=8c064e5a2bd541bfbd7bc8f907eb0c6b&scope.project.id=e6f4dff019ce498a83a657e99d361977&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:52.592556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63682383-21b7-4f4a-b20a-e86bb03d134d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:52.593071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63682383-21b7-4f4a-b20a-e86bb03d134d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:52.593156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63682383-21b7-4f4a-b20a-e86bb03d134d None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:52.594485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 577/1147] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:52.599783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89be7-6ce3-40bb-ad7e-e8cbb74a9954 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:52.600176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89be7-6ce3-40bb-ad7e-e8cbb74a9954 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:52.600347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89be7-6ce3-40bb-ad7e-e8cbb74a9954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:52.618647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b6b89be7-6ce3-40bb-ad7e-e8cbb74a9954 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:52.620442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b6b89be7-6ce3-40bb-ad7e-e8cbb74a9954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:52.684304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:52.691596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 571/1148] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:52.958403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63682383-21b7-4f4a-b20a-e86bb03d134d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:53.059541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63682383-21b7-4f4a-b20a-e86bb03d134d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:53.075887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:53.093276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888259f2-507a-43b6-9f95-c4926d359fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:53.093897 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888259f2-507a-43b6-9f95-c4926d359fdb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:53.094180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888259f2-507a-43b6-9f95-c4926d359fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:53.094455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888259f2-507a-43b6-9f95-c4926d359fdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:53.104465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888259f2-507a-43b6-9f95-c4926d359fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-888259f2-507a-43b6-9f95-c4926d359fdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:53.109421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:53.110534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:53.111419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 578/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:37:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:53.116594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b89be7-6ce3-40bb-ad7e-e8cbb74a9954 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:53.216275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b89be7-6ce3-40bb-ad7e-e8cbb74a9954 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:53.249629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7b86d-e624-41cf-b79a-11355c27b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:53.250232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7b86d-e624-41cf-b79a-11355c27b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:53.250511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7b86d-e624-41cf-b79a-11355c27b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:53.250782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7b86d-e624-41cf-b79a-11355c27b0a2 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:53.251473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7b86d-e624-41cf-b79a-11355c27b0a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:53.251777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7b86d-e624-41cf-b79a-11355c27b0a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:53.253130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7b86d-e624-41cf-b79a-11355c27b0a2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:53.261597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 572/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:37:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:53.267614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888259f2-507a-43b6-9f95-c4926d359fdb None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:53.366537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888259f2-507a-43b6-9f95-c4926d359fdb None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:53.401288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8d8f0-696e-4dc9-a9e6-b5e3b0274ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:53.401907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8d8f0-696e-4dc9-a9e6-b5e3b0274ba5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:53.402189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8d8f0-696e-4dc9-a9e6-b5e3b0274ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:53.402464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8d8f0-696e-4dc9-a9e6-b5e3b0274ba5 None admin] PATH_INFO: `/v3/users/8c064e5a2bd541bfbd7bc8f907eb0c6b` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:53.403613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8d8f0-696e-4dc9-a9e6-b5e3b0274ba5 None admin] RBAC: Authorizing `identity:get_user(user_id=8c064e5a2bd541bfbd7bc8f907eb0c6b)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:53.405047 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8d8f0-696e-4dc9-a9e6-b5e3b0274ba5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:53.406633 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 579/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:53 2022] GET /identity/v3/users/8c064e5a2bd541bfbd7bc8f907eb0c6b => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:53.412398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7b86d-e624-41cf-b79a-11355c27b0a2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:53.471631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:53.512314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7b86d-e624-41cf-b79a-11355c27b0a2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:53.544473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee598b-f2a0-49cf-96c8-3449ef7bb229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:53.545091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee598b-f2a0-49cf-96c8-3449ef7bb229 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:53.545373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee598b-f2a0-49cf-96c8-3449ef7bb229 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:53.545653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee598b-f2a0-49cf-96c8-3449ef7bb229 None admin] PATH_INFO: `/v3/projects/e6f4dff019ce498a83a657e99d361977` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:53.546762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee598b-f2a0-49cf-96c8-3449ef7bb229 None admin] RBAC: Authorizing `identity:get_project(project_id=e6f4dff019ce498a83a657e99d361977)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:53.548585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee598b-f2a0-49cf-96c8-3449ef7bb229 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:53.550189 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 573/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:37:53 2022] GET /identity/v3/projects/e6f4dff019ce498a83a657e99d361977 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:53.556186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8d8f0-696e-4dc9-a9e6-b5e3b0274ba5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:53.601764 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:53.653674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8d8f0-696e-4dc9-a9e6-b5e3b0274ba5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:53.686617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f74613-53f1-4039-a497-f5b6e1e9b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:53.687263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74613-53f1-4039-a497-f5b6e1e9b7da None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:53.687576 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74613-53f1-4039-a497-f5b6e1e9b7da None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:53.687851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74613-53f1-4039-a497-f5b6e1e9b7da None admin] PATH_INFO: `/v3/projects/e6f4dff019ce498a83a657e99d361977/users/8c064e5a2bd541bfbd7bc8f907eb0c6b/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:53.689715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f74613-53f1-4039-a497-f5b6e1e9b7da None admin] RBAC: Authorizing `identity:create_grant(project_id=e6f4dff019ce498a83a657e99d361977, user_id=8c064e5a2bd541bfbd7bc8f907eb0c6b, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:53.691128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f74613-53f1-4039-a497-f5b6e1e9b7da None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:53.789323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 580/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:37:53 2022] PUT /identity/v3/projects/e6f4dff019ce498a83a657e99d361977/users/8c064e5a2bd541bfbd7bc8f907eb0c6b/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:37:55.685587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189012ef-13be-417f-851e-c67fe336c888 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:55.686086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189012ef-13be-417f-851e-c67fe336c888 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:55.686086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189012ef-13be-417f-851e-c67fe336c888 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:55.687675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 574/1154] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:55.692785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ca6cb-ed1d-45f9-8390-1c4e5bbbd1ef None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:55.693282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ca6cb-ed1d-45f9-8390-1c4e5bbbd1ef None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:55.693445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ca6cb-ed1d-45f9-8390-1c4e5bbbd1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:55.711681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-373ca6cb-ed1d-45f9-8390-1c4e5bbbd1ef None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:55.712907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-373ca6cb-ed1d-45f9-8390-1c4e5bbbd1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:55.778333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 581/1155] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:56.059893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189012ef-13be-417f-851e-c67fe336c888 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:56.159437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189012ef-13be-417f-851e-c67fe336c888 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:56.183697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:56.191954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962bf6e-3f28-4c3a-b90e-fbe374fa3f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:56.192560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962bf6e-3f28-4c3a-b90e-fbe374fa3f13 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:56.192835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962bf6e-3f28-4c3a-b90e-fbe374fa3f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:56.193101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962bf6e-3f28-4c3a-b90e-fbe374fa3f13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:56.203421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962bf6e-3f28-4c3a-b90e-fbe374fa3f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-8962bf6e-3f28-4c3a-b90e-fbe374fa3f13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:37:56.208353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:56.209437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:37:56.210411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 575/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:56.215655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ca6cb-ed1d-45f9-8390-1c4e5bbbd1ef None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:56.248268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:56.313416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ca6cb-ed1d-45f9-8390-1c4e5bbbd1ef None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:56.349109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a847-7607-4f58-842b-9f671594fc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:56.349710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a847-7607-4f58-842b-9f671594fc70 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:56.349994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a847-7607-4f58-842b-9f671594fc70 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:56.350262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979a847-7607-4f58-842b-9f671594fc70 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:56.350919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979a847-7607-4f58-842b-9f671594fc70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:56.351216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979a847-7607-4f58-842b-9f671594fc70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:56.352599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979a847-7607-4f58-842b-9f671594fc70 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:56.360993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 582/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:56.366717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962bf6e-3f28-4c3a-b90e-fbe374fa3f13 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:56.461791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962bf6e-3f28-4c3a-b90e-fbe374fa3f13 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:56.493642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c3da-5654-484d-a07a-bc612c4998fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:56.494839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c3da-5654-484d-a07a-bc612c4998fe None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:56.495116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c3da-5654-484d-a07a-bc612c4998fe None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:56.495409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10c3da-5654-484d-a07a-bc612c4998fe None admin] PATH_INFO: `/v3/users/8c064e5a2bd541bfbd7bc8f907eb0c6b` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:56.496497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10c3da-5654-484d-a07a-bc612c4998fe None admin] RBAC: Authorizing `identity:get_user(user_id=8c064e5a2bd541bfbd7bc8f907eb0c6b)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:56.497897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10c3da-5654-484d-a07a-bc612c4998fe None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:56.499429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 576/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:37:56 2022] GET /identity/v3/users/8c064e5a2bd541bfbd7bc8f907eb0c6b => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:56.505251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a847-7607-4f58-842b-9f671594fc70 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:56.596596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:56.602266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979a847-7607-4f58-842b-9f671594fc70 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:56.635893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf2191-8034-4b23-aa75-8c3e6411a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:56.636485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf2191-8034-4b23-aa75-8c3e6411a646 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:56.636766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf2191-8034-4b23-aa75-8c3e6411a646 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:56.637038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf2191-8034-4b23-aa75-8c3e6411a646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:56.704460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf2191-8034-4b23-aa75-8c3e6411a646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:56.705905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf2191-8034-4b23-aa75-8c3e6411a646 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:56.798271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:56.804616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 583/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:37:56.811319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c3da-5654-484d-a07a-bc612c4998fe None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:56.866578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:56.910703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10c3da-5654-484d-a07a-bc612c4998fe None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:56.944008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1b295-8b07-4ff2-bdc0-68a8f6efba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:56.944615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1b295-8b07-4ff2-bdc0-68a8f6efba84 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:56.944892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1b295-8b07-4ff2-bdc0-68a8f6efba84 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:56.945164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1b295-8b07-4ff2-bdc0-68a8f6efba84 None admin] PATH_INFO: `/v3/projects/e6f4dff019ce498a83a657e99d361977` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:56.946253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1b295-8b07-4ff2-bdc0-68a8f6efba84 None admin] RBAC: Authorizing `identity:get_project(project_id=e6f4dff019ce498a83a657e99d361977)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:56.948701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1b295-8b07-4ff2-bdc0-68a8f6efba84 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:56.950291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 577/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:37:56 2022] GET /identity/v3/projects/e6f4dff019ce498a83a657e99d361977 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:37:56.956602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf2191-8034-4b23-aa75-8c3e6411a646 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:57.051835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf2191-8034-4b23-aa75-8c3e6411a646 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:57.086524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3ad19-d169-458a-86f3-4ab0d356cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:57.087110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3ad19-d169-458a-86f3-4ab0d356cce1 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:57.087415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3ad19-d169-458a-86f3-4ab0d356cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:57.088309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3ad19-d169-458a-86f3-4ab0d356cce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:57.089074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3ad19-d169-458a-86f3-4ab0d356cce1 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=e6f4dff019ce498a83a657e99d361977, user.id=8c064e5a2bd541bfbd7bc8f907eb0c6b) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:57.089376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3ad19-d169-458a-86f3-4ab0d356cce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:57.090798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3ad19-d169-458a-86f3-4ab0d356cce1 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:57.096421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 584/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:37:56 2022] GET /identity/v3/role_assignments?user.id=8c064e5a2bd541bfbd7bc8f907eb0c6b&scope.project.id=e6f4dff019ce498a83a657e99d361977&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:37:59.007999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afe982-0d13-4af1-8454-7ebc22e53e3e None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:59.008548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afe982-0d13-4af1-8454-7ebc22e53e3e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:59.008548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afe982-0d13-4af1-8454-7ebc22e53e3e None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:59.009866 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 578/1162] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:37:59.015193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae922cfc-6be6-4ed5-941b-6534ae6b6901 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:59.015641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae922cfc-6be6-4ed5-941b-6534ae6b6901 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:59.015807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae922cfc-6be6-4ed5-941b-6534ae6b6901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:59.034083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ae922cfc-6be6-4ed5-941b-6534ae6b6901 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:37:59.035267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ae922cfc-6be6-4ed5-941b-6534ae6b6901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:37:59.090829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:59.101639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 585/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:37:59.370899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afe982-0d13-4af1-8454-7ebc22e53e3e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:59.471516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afe982-0d13-4af1-8454-7ebc22e53e3e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:59.493311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:59.505124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eede80-b396-479e-b159-8ad70f59c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:59.506743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eede80-b396-479e-b159-8ad70f59c26e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:59.506743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eede80-b396-479e-b159-8ad70f59c26e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:59.506743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eede80-b396-479e-b159-8ad70f59c26e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:59.575184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eede80-b396-479e-b159-8ad70f59c26e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:59.576657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eede80-b396-479e-b159-8ad70f59c26e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:59.671880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 579/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:37:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:37:59.678129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae922cfc-6be6-4ed5-941b-6534ae6b6901 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:59.776324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae922cfc-6be6-4ed5-941b-6534ae6b6901 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:59.810703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2e943-a72d-4ca0-aadd-42bd707de809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:59.811345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2e943-a72d-4ca0-aadd-42bd707de809 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:59.811637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2e943-a72d-4ca0-aadd-42bd707de809 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:59.811907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2e943-a72d-4ca0-aadd-42bd707de809 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:59.818846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2e943-a72d-4ca0-aadd-42bd707de809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:59.820308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2e943-a72d-4ca0-aadd-42bd707de809 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-74f2e943-a72d-4ca0-aadd-42bd707de809 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:37:59.831760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:37:59.832992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:37:59.834100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 586/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:37:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:37:59.840482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eede80-b396-479e-b159-8ad70f59c26e None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:37:59.864432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:37:59.940685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eede80-b396-479e-b159-8ad70f59c26e None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:37:59.973615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cf57e-7776-4244-b370-3b019698b80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:37:59.974212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cf57e-7776-4244-b370-3b019698b80e None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:37:59.974516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cf57e-7776-4244-b370-3b019698b80e None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:37:59.974987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cf57e-7776-4244-b370-3b019698b80e None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:37:59.975958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cf57e-7776-4244-b370-3b019698b80e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:37:59.976266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cf57e-7776-4244-b370-3b019698b80e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:37:59.977629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cf57e-7776-4244-b370-3b019698b80e None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:37:59.985963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 580/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 24 07:37:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:01.867470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382714-70bd-49a3-bd0d-a8e063f5e77b None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:01.868019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382714-70bd-49a3-bd0d-a8e063f5e77b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:01.868019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382714-70bd-49a3-bd0d-a8e063f5e77b None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:01.869945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 587/1167] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:38:01.875378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a007ef4-240b-47e8-bc70-7f406310529b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:01.875817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a007ef4-240b-47e8-bc70-7f406310529b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:01.875927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a007ef4-240b-47e8-bc70-7f406310529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:01.893884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2a007ef4-240b-47e8-bc70-7f406310529b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:38:01.895050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2a007ef4-240b-47e8-bc70-7f406310529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:38:01.958954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 581/1168] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:38:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:38:02.224820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4382714-70bd-49a3-bd0d-a8e063f5e77b None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:02.275063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:02.324788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4382714-70bd-49a3-bd0d-a8e063f5e77b None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:02.360233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf09cf-a121-4c48-890e-ffbcd83aaa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:02.360856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf09cf-a121-4c48-890e-ffbcd83aaa10 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:02.361339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf09cf-a121-4c48-890e-ffbcd83aaa10 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:02.361843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf09cf-a121-4c48-890e-ffbcd83aaa10 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:02.362932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf09cf-a121-4c48-890e-ffbcd83aaa10 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:02.364444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf09cf-a121-4c48-890e-ffbcd83aaa10 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:02.430275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 588/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Wed Aug 24 07:38:02 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:38:04.364435 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58caedf-e823-4924-9424-8bc5396d19b4 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:04.364917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58caedf-e823-4924-9424-8bc5396d19b4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:04.365010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58caedf-e823-4924-9424-8bc5396d19b4 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:04.366322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 582/1170] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:38:04.372715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6e8c5-5033-4626-b344-1257c91b1b2f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:04.373123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6e8c5-5033-4626-b344-1257c91b1b2f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:04.373277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6e8c5-5033-4626-b344-1257c91b1b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:04.390834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a6d6e8c5-5033-4626-b344-1257c91b1b2f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:38:04.392043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a6d6e8c5-5033-4626-b344-1257c91b1b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:38:04.456238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 589/1171] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:38:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:38:04.727748 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58caedf-e823-4924-9424-8bc5396d19b4 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:04.746189 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:04.825462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58caedf-e823-4924-9424-8bc5396d19b4 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:04.857969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffde29-5c9a-4fa4-9217-e7a65b949dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:04.858576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffde29-5c9a-4fa4-9217-e7a65b949dc9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:04.858862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffde29-5c9a-4fa4-9217-e7a65b949dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:04.859131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffde29-5c9a-4fa4-9217-e7a65b949dc9 None admin] PATH_INFO: `/v3/domains/97f76f6b82254ed8b92ee5685a18177b` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:04.869834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffde29-5c9a-4fa4-9217-e7a65b949dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=97f76f6b82254ed8b92ee5685a18177b)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:04.871248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffde29-5c9a-4fa4-9217-e7a65b949dc9 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:04.872838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 583/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Aug 24 07:38:04 2022] GET /identity/v3/domains/97f76f6b82254ed8b92ee5685a18177b => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:04.878557 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6e8c5-5033-4626-b344-1257c91b1b2f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:04.920428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:04.977473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6e8c5-5033-4626-b344-1257c91b1b2f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:05.012086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed470ac-46b0-471b-a04e-9d8abdbd53a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:05.012685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed470ac-46b0-471b-a04e-9d8abdbd53a8 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:05.012968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed470ac-46b0-471b-a04e-9d8abdbd53a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:05.013242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed470ac-46b0-471b-a04e-9d8abdbd53a8 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:05.013885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed470ac-46b0-471b-a04e-9d8abdbd53a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:05.015351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed470ac-46b0-471b-a04e-9d8abdbd53a8 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:05.125875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 590/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:38:04 2022] POST /identity/v3/projects => generated 361 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:38:07.076653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0684577-d41c-4a5b-bd6d-0ffa178b5b66 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:07.077248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0684577-d41c-4a5b-bd6d-0ffa178b5b66 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:07.077248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0684577-d41c-4a5b-bd6d-0ffa178b5b66 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:07.078525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 584/1174] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:38:07.083895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d26cc-66d6-4721-b545-9c9cf246c154 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:07.084290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d26cc-66d6-4721-b545-9c9cf246c154 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:07.084449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d26cc-66d6-4721-b545-9c9cf246c154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:07.103771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2d6d26cc-66d6-4721-b545-9c9cf246c154 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:38:07.104942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2d6d26cc-66d6-4721-b545-9c9cf246c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:38:07.168772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 591/1175] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:38:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:38:07.440100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0684577-d41c-4a5b-bd6d-0ffa178b5b66 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:07.519234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:07.542872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0684577-d41c-4a5b-bd6d-0ffa178b5b66 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:07.577572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf4e6d-d431-4be1-9334-69ea80b048a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:07.578184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf4e6d-d431-4be1-9334-69ea80b048a8 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:07.578470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf4e6d-d431-4be1-9334-69ea80b048a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:07.578743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf4e6d-d431-4be1-9334-69ea80b048a8 None admin] PATH_INFO: `/v3/domains/97f76f6b82254ed8b92ee5685a18177b` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:07.579873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf4e6d-d431-4be1-9334-69ea80b048a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=97f76f6b82254ed8b92ee5685a18177b)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:07.581284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf4e6d-d431-4be1-9334-69ea80b048a8 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:07.582814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 585/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Aug 24 07:38:07 2022] GET /identity/v3/domains/97f76f6b82254ed8b92ee5685a18177b => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:07.588785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d26cc-66d6-4721-b545-9c9cf246c154 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:07.612471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:07.695737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d26cc-66d6-4721-b545-9c9cf246c154 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:07.732375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc81fa9-a352-4a26-bb23-4790895417b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:07.732977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81fa9-a352-4a26-bb23-4790895417b5 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:07.733253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81fa9-a352-4a26-bb23-4790895417b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:07.733548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81fa9-a352-4a26-bb23-4790895417b5 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:07.734179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc81fa9-a352-4a26-bb23-4790895417b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:07.735630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc81fa9-a352-4a26-bb23-4790895417b5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:07.828107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 592/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:38:07 2022] POST /identity/v3/users => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:38:09.787062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4499-c9b3-4a9d-9cee-5fe639d3e4b5 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:09.787639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4499-c9b3-4a9d-9cee-5fe639d3e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:09.787639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4499-c9b3-4a9d-9cee-5fe639d3e4b5 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:09.788945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 586/1178] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:38:09.794423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9ffe2-028b-45bb-af23-9f7f42ae0d9c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:09.794844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9ffe2-028b-45bb-af23-9f7f42ae0d9c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:09.794978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9ffe2-028b-45bb-af23-9f7f42ae0d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:09.813119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-aab9ffe2-028b-45bb-af23-9f7f42ae0d9c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:38:09.814285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-aab9ffe2-028b-45bb-af23-9f7f42ae0d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:38:09.879206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 593/1179] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:38:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:38:10.147626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed4499-c9b3-4a9d-9cee-5fe639d3e4b5 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:10.247129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed4499-c9b3-4a9d-9cee-5fe639d3e4b5 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:10.280379 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7aaa0-7ed9-4dd1-94d7-63047df955f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:10.280992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7aaa0-7ed9-4dd1-94d7-63047df955f9 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:10.281271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7aaa0-7ed9-4dd1-94d7-63047df955f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:10.281539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7aaa0-7ed9-4dd1-94d7-63047df955f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:10.291904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7aaa0-7ed9-4dd1-94d7-63047df955f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-f0a7aaa0-7ed9-4dd1-94d7-63047df955f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:38:10.296832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:38:10.297990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:38:10.299102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 587/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:38:10.303995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9ffe2-028b-45bb-af23-9f7f42ae0d9c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:10.314732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:10.403482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9ffe2-028b-45bb-af23-9f7f42ae0d9c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:10.437646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21363ac-5909-4866-9015-a63796fd84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:10.438251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21363ac-5909-4866-9015-a63796fd84ef None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:10.438532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21363ac-5909-4866-9015-a63796fd84ef None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:10.438806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21363ac-5909-4866-9015-a63796fd84ef None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:10.439497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21363ac-5909-4866-9015-a63796fd84ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:38:10.439805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21363ac-5909-4866-9015-a63796fd84ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:10.441174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21363ac-5909-4866-9015-a63796fd84ef None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:10.449146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 594/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:10.454975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7aaa0-7ed9-4dd1-94d7-63047df955f9 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:10.459265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:10.551574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7aaa0-7ed9-4dd1-94d7-63047df955f9 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:10.583804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a9a0-515b-4525-84f1-6efc265dec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:10.584403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a9a0-515b-4525-84f1-6efc265dec97 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:10.584677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a9a0-515b-4525-84f1-6efc265dec97 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:10.584943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a9a0-515b-4525-84f1-6efc265dec97 None admin] PATH_INFO: `/v3/users/5510af1b9cee46e999210b7a8c79b003` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:10.597398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a9a0-515b-4525-84f1-6efc265dec97 None admin] RBAC: Authorizing `identity:get_user(user_id=5510af1b9cee46e999210b7a8c79b003)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:10.598813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a9a0-515b-4525-84f1-6efc265dec97 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:10.600396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 588/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:38:10 2022] GET /identity/v3/users/5510af1b9cee46e999210b7a8c79b003 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:10.606802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21363ac-5909-4866-9015-a63796fd84ef None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:10.675580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:10.706833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21363ac-5909-4866-9015-a63796fd84ef None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:10.739832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cda9e-03d6-4c0e-8209-8eaa3b838670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:10.740436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cda9e-03d6-4c0e-8209-8eaa3b838670 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:10.740712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cda9e-03d6-4c0e-8209-8eaa3b838670 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:10.740986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cda9e-03d6-4c0e-8209-8eaa3b838670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:10.809898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cda9e-03d6-4c0e-8209-8eaa3b838670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:10.811376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cda9e-03d6-4c0e-8209-8eaa3b838670 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:10.880136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:10.912137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 595/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:38:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:38:10.918071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a9a0-515b-4525-84f1-6efc265dec97 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:10.980529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:11.019075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a9a0-515b-4525-84f1-6efc265dec97 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:11.056051 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facff4d1-d455-4100-92ca-d41d038b5cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:11.056740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff4d1-d455-4100-92ca-d41d038b5cbb None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:11.057016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff4d1-d455-4100-92ca-d41d038b5cbb None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:11.057283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facff4d1-d455-4100-92ca-d41d038b5cbb None admin] PATH_INFO: `/v3/projects/c453b71d690a405c926c80bc5496e0a2` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:11.058408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facff4d1-d455-4100-92ca-d41d038b5cbb None admin] RBAC: Authorizing `identity:get_project(project_id=c453b71d690a405c926c80bc5496e0a2)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:11.059854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facff4d1-d455-4100-92ca-d41d038b5cbb None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:11.061454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 589/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:38:10 2022] GET /identity/v3/projects/c453b71d690a405c926c80bc5496e0a2 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:38:11.067854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cda9e-03d6-4c0e-8209-8eaa3b838670 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:11.165680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cda9e-03d6-4c0e-8209-8eaa3b838670 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:11.198380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c9193-3f2c-4516-a084-f9fb3d4c5795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:11.199045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9193-3f2c-4516-a084-f9fb3d4c5795 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:11.199348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9193-3f2c-4516-a084-f9fb3d4c5795 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:11.199617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c9193-3f2c-4516-a084-f9fb3d4c5795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:11.200327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c9193-3f2c-4516-a084-f9fb3d4c5795 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=c453b71d690a405c926c80bc5496e0a2, user.id=5510af1b9cee46e999210b7a8c79b003) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:38:11.200629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c9193-3f2c-4516-a084-f9fb3d4c5795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:11.202041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c9193-3f2c-4516-a084-f9fb3d4c5795 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:11.207183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 596/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:38:11 2022] GET /identity/v3/role_assignments?user.id=5510af1b9cee46e999210b7a8c79b003&scope.project.id=c453b71d690a405c926c80bc5496e0a2&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:13.101816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e146-ea7e-4049-9d3d-d61ef4271c8c None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:13.102417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e146-ea7e-4049-9d3d-d61ef4271c8c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:13.102629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e146-ea7e-4049-9d3d-d61ef4271c8c None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:13.103993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 590/1186] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:38:13.109240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de5f3a-1e75-4a41-bdde-e6968b2579eb None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:13.109605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de5f3a-1e75-4a41-bdde-e6968b2579eb None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:13.109794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de5f3a-1e75-4a41-bdde-e6968b2579eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:13.128129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-16de5f3a-1e75-4a41-bdde-e6968b2579eb None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:38:13.129310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-16de5f3a-1e75-4a41-bdde-e6968b2579eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:38:13.155748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:13.196267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 597/1187] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:38:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:38:13.469712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e146-ea7e-4049-9d3d-d61ef4271c8c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:13.568131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e146-ea7e-4049-9d3d-d61ef4271c8c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:13.597666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:13.603178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1304192-f1e3-464c-979d-725e58a6244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:13.603823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1304192-f1e3-464c-979d-725e58a6244c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:13.616430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1304192-f1e3-464c-979d-725e58a6244c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:13.616430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1304192-f1e3-464c-979d-725e58a6244c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:13.616430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1304192-f1e3-464c-979d-725e58a6244c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-d1304192-f1e3-464c-979d-725e58a6244c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:38:13.618712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:38:13.620178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:38:13.621893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 591/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:38:13.626003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de5f3a-1e75-4a41-bdde-e6968b2579eb None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:13.724393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de5f3a-1e75-4a41-bdde-e6968b2579eb None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:13.767878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43120581-c0f6-4a3c-bc32-27e31dbb3c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:13.768679 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120581-c0f6-4a3c-bc32-27e31dbb3c7f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:13.768962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120581-c0f6-4a3c-bc32-27e31dbb3c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:13.769236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120581-c0f6-4a3c-bc32-27e31dbb3c7f None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:13.769916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120581-c0f6-4a3c-bc32-27e31dbb3c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:38:13.770367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120581-c0f6-4a3c-bc32-27e31dbb3c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:13.772681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120581-c0f6-4a3c-bc32-27e31dbb3c7f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:13.782086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 598/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:13.787896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1304192-f1e3-464c-979d-725e58a6244c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:13.886077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1304192-f1e3-464c-979d-725e58a6244c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:13.918815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f1a5-7d14-4938-9846-440f8c8c7c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:13.919462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f1a5-7d14-4938-9846-440f8c8c7c85 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:13.919745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f1a5-7d14-4938-9846-440f8c8c7c85 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:13.920017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693f1a5-7d14-4938-9846-440f8c8c7c85 None admin] PATH_INFO: `/v3/users/5510af1b9cee46e999210b7a8c79b003` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:13.921125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f1a5-7d14-4938-9846-440f8c8c7c85 None admin] RBAC: Authorizing `identity:get_user(user_id=5510af1b9cee46e999210b7a8c79b003)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:13.922820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693f1a5-7d14-4938-9846-440f8c8c7c85 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:13.924403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 592/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:38:13 2022] GET /identity/v3/users/5510af1b9cee46e999210b7a8c79b003 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:13.930660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43120581-c0f6-4a3c-bc32-27e31dbb3c7f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:13.957922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:14.028249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43120581-c0f6-4a3c-bc32-27e31dbb3c7f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:14.067905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad0bb4-3c74-43b0-8162-b389c7ff6f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:14.068581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad0bb4-3c74-43b0-8162-b389c7ff6f18 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:14.068856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad0bb4-3c74-43b0-8162-b389c7ff6f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:14.069125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad0bb4-3c74-43b0-8162-b389c7ff6f18 None admin] PATH_INFO: `/v3/projects/c453b71d690a405c926c80bc5496e0a2` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:14.070237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad0bb4-3c74-43b0-8162-b389c7ff6f18 None admin] RBAC: Authorizing `identity:get_project(project_id=c453b71d690a405c926c80bc5496e0a2)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:14.071749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad0bb4-3c74-43b0-8162-b389c7ff6f18 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:14.073376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 599/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:38:13 2022] GET /identity/v3/projects/c453b71d690a405c926c80bc5496e0a2 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:14.079640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f1a5-7d14-4938-9846-440f8c8c7c85 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:14.136515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:14.177076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693f1a5-7d14-4938-9846-440f8c8c7c85 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:14.209209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebd89b-d1c1-471f-91f4-3b45137c24fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:14.209848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebd89b-d1c1-471f-91f4-3b45137c24fe None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:14.210127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebd89b-d1c1-471f-91f4-3b45137c24fe None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:14.210397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebd89b-d1c1-471f-91f4-3b45137c24fe None admin] PATH_INFO: `/v3/projects/c453b71d690a405c926c80bc5496e0a2/users/5510af1b9cee46e999210b7a8c79b003/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:14.212317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebd89b-d1c1-471f-91f4-3b45137c24fe None admin] RBAC: Authorizing `identity:create_grant(project_id=c453b71d690a405c926c80bc5496e0a2, user_id=5510af1b9cee46e999210b7a8c79b003, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:14.213732 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebd89b-d1c1-471f-91f4-3b45137c24fe None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:14.283411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 593/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:38:14 2022] PUT /identity/v3/projects/c453b71d690a405c926c80bc5496e0a2/users/5510af1b9cee46e999210b7a8c79b003/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:38:16.179414 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1908d26-9990-4caf-93ed-7920c57c073e None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:16.179972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1908d26-9990-4caf-93ed-7920c57c073e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:16.179972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1908d26-9990-4caf-93ed-7920c57c073e None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:16.181324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 600/1193] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:38:16.186614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a948-78dd-4a45-8501-a9a05718d517 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:16.187060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a948-78dd-4a45-8501-a9a05718d517 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:16.187155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a948-78dd-4a45-8501-a9a05718d517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:16.205262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2c29a948-78dd-4a45-8501-a9a05718d517 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:38:16.206460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2c29a948-78dd-4a45-8501-a9a05718d517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:38:16.275789 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 594/1194] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:38:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:38:16.554177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1908d26-9990-4caf-93ed-7920c57c073e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:16.663763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:16.671912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1908d26-9990-4caf-93ed-7920c57c073e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:16.705918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb9ffd-340a-42df-b815-fe55b1662bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:16.706542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb9ffd-340a-42df-b815-fe55b1662bba None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:16.706826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb9ffd-340a-42df-b815-fe55b1662bba None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:16.707103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb9ffd-340a-42df-b815-fe55b1662bba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:16.717760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb9ffd-340a-42df-b815-fe55b1662bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-2feb9ffd-340a-42df-b815-fe55b1662bba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:38:16.722535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:38:16.723788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:38:16.724904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 601/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:38:16.730645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29a948-78dd-4a45-8501-a9a05718d517 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:16.777827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:16.827483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29a948-78dd-4a45-8501-a9a05718d517 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:16.861744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7014bb-94d1-4633-8bfb-2b671cf1eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:16.862346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7014bb-94d1-4633-8bfb-2b671cf1eba0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:16.862626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7014bb-94d1-4633-8bfb-2b671cf1eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:16.862899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7014bb-94d1-4633-8bfb-2b671cf1eba0 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:16.863594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7014bb-94d1-4633-8bfb-2b671cf1eba0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:38:16.863903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7014bb-94d1-4633-8bfb-2b671cf1eba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:16.865259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7014bb-94d1-4633-8bfb-2b671cf1eba0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:16.873141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 595/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:16.878967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb9ffd-340a-42df-b815-fe55b1662bba None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:16.979660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb9ffd-340a-42df-b815-fe55b1662bba None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:17.012872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9e4d-951d-40a2-bf3f-afdd2a49156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:17.013490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9e4d-951d-40a2-bf3f-afdd2a49156e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:17.013777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9e4d-951d-40a2-bf3f-afdd2a49156e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:17.014056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9e4d-951d-40a2-bf3f-afdd2a49156e None admin] PATH_INFO: `/v3/users/5510af1b9cee46e999210b7a8c79b003` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:17.015148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b9e4d-951d-40a2-bf3f-afdd2a49156e None admin] RBAC: Authorizing `identity:get_user(user_id=5510af1b9cee46e999210b7a8c79b003)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:17.016605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b9e4d-951d-40a2-bf3f-afdd2a49156e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:17.018160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 602/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 24 07:38:16 2022] GET /identity/v3/users/5510af1b9cee46e999210b7a8c79b003 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:17.024741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7014bb-94d1-4633-8bfb-2b671cf1eba0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:17.123316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7014bb-94d1-4633-8bfb-2b671cf1eba0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:17.133659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:17.156527 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304c52-f29d-4b92-82b8-e88277a76b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:17.157140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304c52-f29d-4b92-82b8-e88277a76b6c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:17.157417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304c52-f29d-4b92-82b8-e88277a76b6c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:17.157687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304c52-f29d-4b92-82b8-e88277a76b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:17.222451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7304c52-f29d-4b92-82b8-e88277a76b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:17.223940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7304c52-f29d-4b92-82b8-e88277a76b6c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:17.321353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 596/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:38:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:38:17.327343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9e4d-951d-40a2-bf3f-afdd2a49156e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:17.352001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:17.424825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9e4d-951d-40a2-bf3f-afdd2a49156e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:17.457142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71d914-b54e-467b-8e66-10fa5417ab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:17.457754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71d914-b54e-467b-8e66-10fa5417ab6d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:17.458038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71d914-b54e-467b-8e66-10fa5417ab6d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:17.458308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71d914-b54e-467b-8e66-10fa5417ab6d None admin] PATH_INFO: `/v3/projects/c453b71d690a405c926c80bc5496e0a2` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:17.459422 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71d914-b54e-467b-8e66-10fa5417ab6d None admin] RBAC: Authorizing `identity:get_project(project_id=c453b71d690a405c926c80bc5496e0a2)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:17.460898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71d914-b54e-467b-8e66-10fa5417ab6d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:17.462674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 603/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 24 07:38:17 2022] GET /identity/v3/projects/c453b71d690a405c926c80bc5496e0a2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:17.468834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304c52-f29d-4b92-82b8-e88277a76b6c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:38:17.480164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:17.567826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304c52-f29d-4b92-82b8-e88277a76b6c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:38:17.602129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966efd15-a3a8-4645-a41f-46de2cc49cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:38:17.602713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966efd15-a3a8-4645-a41f-46de2cc49cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:38:17.602992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966efd15-a3a8-4645-a41f-46de2cc49cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:38:17.603264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966efd15-a3a8-4645-a41f-46de2cc49cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:38:17.604011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966efd15-a3a8-4645-a41f-46de2cc49cb7 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=c453b71d690a405c926c80bc5496e0a2, user.id=5510af1b9cee46e999210b7a8c79b003) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:38:17.604319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966efd15-a3a8-4645-a41f-46de2cc49cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:38:17.605736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966efd15-a3a8-4645-a41f-46de2cc49cb7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:38:17.611276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 597/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:38:17 2022] GET /identity/v3/role_assignments?user.id=5510af1b9cee46e999210b7a8c79b003&scope.project.id=c453b71d690a405c926c80bc5496e0a2&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:38:27.453194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=55 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:27.608856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=63 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:30.413461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ac82-2518-4f65-9aa9-c921190da69e None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:30.414062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ac82-2518-4f65-9aa9-c921190da69e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:30.414062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ac82-2518-4f65-9aa9-c921190da69e None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:30.415440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 604/1201] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:39:30.420908 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f310ba-3a59-4225-9886-782e36b671ac None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:30.421396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f310ba-3a59-4225-9886-782e36b671ac None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:30.421499 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f310ba-3a59-4225-9886-782e36b671ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:30.439533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d3f310ba-3a59-4225-9886-782e36b671ac None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:39:30.440725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d3f310ba-3a59-4225-9886-782e36b671ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:39:30.508833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 598/1202] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:39:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:39:30.782650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ac82-2518-4f65-9aa9-c921190da69e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:30.885368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ac82-2518-4f65-9aa9-c921190da69e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:30.919191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f897533-4a5d-4eb4-84bc-9a17c2c2ab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:30.919856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f897533-4a5d-4eb4-84bc-9a17c2c2ab07 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:30.920138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f897533-4a5d-4eb4-84bc-9a17c2c2ab07 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:30.920412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f897533-4a5d-4eb4-84bc-9a17c2c2ab07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:30.931334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f897533-4a5d-4eb4-84bc-9a17c2c2ab07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:30.932777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f897533-4a5d-4eb4-84bc-9a17c2c2ab07 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-6f897533-4a5d-4eb4-84bc-9a17c2c2ab07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:30.947180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:30.948377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:30.949435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:30.949435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:30.949435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:30.949435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 605/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:30.954327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f310ba-3a59-4225-9886-782e36b671ac None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:31.051650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f310ba-3a59-4225-9886-782e36b671ac None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:31.079135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:31.085362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae5a38-6968-4aad-ba1e-730f1eacd607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:31.085967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5a38-6968-4aad-ba1e-730f1eacd607 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:31.086238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5a38-6968-4aad-ba1e-730f1eacd607 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:31.086501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae5a38-6968-4aad-ba1e-730f1eacd607 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:31.087125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5a38-6968-4aad-ba1e-730f1eacd607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:31.087460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5a38-6968-4aad-ba1e-730f1eacd607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:31.088803 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae5a38-6968-4aad-ba1e-730f1eacd607 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:31.100613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 599/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:31.106502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f897533-4a5d-4eb4-84bc-9a17c2c2ab07 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:31.161130 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:31.206235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f897533-4a5d-4eb4-84bc-9a17c2c2ab07 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:31.241437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23e124-3845-4ee1-b4ce-134921fa658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:31.242097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23e124-3845-4ee1-b4ce-134921fa658f None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:31.242352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23e124-3845-4ee1-b4ce-134921fa658f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:31.242621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23e124-3845-4ee1-b4ce-134921fa658f None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:31.243312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23e124-3845-4ee1-b4ce-134921fa658f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:31.244752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23e124-3845-4ee1-b4ce-134921fa658f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:31.319995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 606/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 24 07:39:31 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:39:33.288711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1176e-e7d5-46dc-b80c-aaec9ee87d5d None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:33.289306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1176e-e7d5-46dc-b80c-aaec9ee87d5d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:33.289306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1176e-e7d5-46dc-b80c-aaec9ee87d5d None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:33.290597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 600/1206] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:39:33.296023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42a1fc-cca6-43f5-92e9-e49c3d20c12a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:33.296445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42a1fc-cca6-43f5-92e9-e49c3d20c12a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:33.296565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42a1fc-cca6-43f5-92e9-e49c3d20c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:33.316745 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-7f42a1fc-cca6-43f5-92e9-e49c3d20c12a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:39:33.317946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7f42a1fc-cca6-43f5-92e9-e49c3d20c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:39:33.387146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 607/1207] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:39:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:39:33.659430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1176e-e7d5-46dc-b80c-aaec9ee87d5d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:33.761070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1176e-e7d5-46dc-b80c-aaec9ee87d5d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:33.795560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef49d6a-9f72-4b42-97c1-51950af7a034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:33.796174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef49d6a-9f72-4b42-97c1-51950af7a034 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:33.796449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef49d6a-9f72-4b42-97c1-51950af7a034 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:33.796720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef49d6a-9f72-4b42-97c1-51950af7a034 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:33.807152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef49d6a-9f72-4b42-97c1-51950af7a034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-cef49d6a-9f72-4b42-97c1-51950af7a034 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:39:33.811972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:33.813174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:33.814176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 601/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:39:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:33.819783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42a1fc-cca6-43f5-92e9-e49c3d20c12a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:33.857938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:33.917932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42a1fc-cca6-43f5-92e9-e49c3d20c12a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:33.951726 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eed3e-be21-420e-8a7f-fcd4d3031c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:33.952325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eed3e-be21-420e-8a7f-fcd4d3031c02 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:33.952624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eed3e-be21-420e-8a7f-fcd4d3031c02 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:33.952885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eed3e-be21-420e-8a7f-fcd4d3031c02 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:33.953546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eed3e-be21-420e-8a7f-fcd4d3031c02 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:33.953844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eed3e-be21-420e-8a7f-fcd4d3031c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:33.955487 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eed3e-be21-420e-8a7f-fcd4d3031c02 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:33.963106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 608/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:33.968952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef49d6a-9f72-4b42-97c1-51950af7a034 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:34.019836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:34.072071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef49d6a-9f72-4b42-97c1-51950af7a034 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:34.106154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93111f1-9a8f-4852-9d7d-a2dbca975d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:34.106778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93111f1-9a8f-4852-9d7d-a2dbca975d6d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:34.107060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93111f1-9a8f-4852-9d7d-a2dbca975d6d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:34.107363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93111f1-9a8f-4852-9d7d-a2dbca975d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:34.118314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93111f1-9a8f-4852-9d7d-a2dbca975d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:34.119797 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93111f1-9a8f-4852-9d7d-a2dbca975d6d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-c93111f1-9a8f-4852-9d7d-a2dbca975d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:34.135725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:34.136880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:34.137823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:34.137823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:34.137823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:34.137823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 602/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:34.143097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eed3e-be21-420e-8a7f-fcd4d3031c02 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:34.244269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:34.247332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eed3e-be21-420e-8a7f-fcd4d3031c02 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:34.282670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61a647-5468-459d-a43a-db916db2e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:34.283845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61a647-5468-459d-a43a-db916db2e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:34.284325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61a647-5468-459d-a43a-db916db2e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:34.284611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61a647-5468-459d-a43a-db916db2e2b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:34.285316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61a647-5468-459d-a43a-db916db2e2b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:34.285660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61a647-5468-459d-a43a-db916db2e2b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:34.287043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61a647-5468-459d-a43a-db916db2e2b6 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:34.300344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 609/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:34.306063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93111f1-9a8f-4852-9d7d-a2dbca975d6d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:34.410417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93111f1-9a8f-4852-9d7d-a2dbca975d6d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:34.411941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:34.445227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282405e-43f8-43db-b60a-9b274f5ab07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:34.445842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282405e-43f8-43db-b60a-9b274f5ab07c None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:34.446119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282405e-43f8-43db-b60a-9b274f5ab07c None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:34.446426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282405e-43f8-43db-b60a-9b274f5ab07c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:34.453279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282405e-43f8-43db-b60a-9b274f5ab07c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:34.454695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282405e-43f8-43db-b60a-9b274f5ab07c None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-c282405e-43f8-43db-b60a-9b274f5ab07c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:39:34.466810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:34.467953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:34.469003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 603/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:34.474450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61a647-5468-459d-a43a-db916db2e2b6 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:34.575311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61a647-5468-459d-a43a-db916db2e2b6 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:34.609444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e343a-3679-4f20-9225-089fca074e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:34.610045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e343a-3679-4f20-9225-089fca074e4c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:34.610323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e343a-3679-4f20-9225-089fca074e4c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:34.610591 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e343a-3679-4f20-9225-089fca074e4c None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:34.612049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e343a-3679-4f20-9225-089fca074e4c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:34.612359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e343a-3679-4f20-9225-089fca074e4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:34.613793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e343a-3679-4f20-9225-089fca074e4c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:34.630544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 610/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 07:39:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:34.636377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282405e-43f8-43db-b60a-9b274f5ab07c None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:34.737525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282405e-43f8-43db-b60a-9b274f5ab07c None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:34.771004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae12e5-9d32-4176-84a3-9fce527021aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:34.771699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae12e5-9d32-4176-84a3-9fce527021aa None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:34.771981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae12e5-9d32-4176-84a3-9fce527021aa None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:34.772256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae12e5-9d32-4176-84a3-9fce527021aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:34.802282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:34.840964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae12e5-9d32-4176-84a3-9fce527021aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:34.842536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae12e5-9d32-4176-84a3-9fce527021aa None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:34.937636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 604/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:39:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:39:34.943491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e343a-3679-4f20-9225-089fca074e4c None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:34.963084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:35.043174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e343a-3679-4f20-9225-089fca074e4c None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:35.076374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60a44d-d842-4d24-a380-14ac695bdd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:35.076994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60a44d-d842-4d24-a380-14ac695bdd6e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:35.077274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60a44d-d842-4d24-a380-14ac695bdd6e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:35.077547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60a44d-d842-4d24-a380-14ac695bdd6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:35.088292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60a44d-d842-4d24-a380-14ac695bdd6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:35.089732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60a44d-d842-4d24-a380-14ac695bdd6e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-ae60a44d-d842-4d24-a380-14ac695bdd6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:35.104349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:35.105491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:35.106564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:35.106564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:35.106564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:35.106564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 611/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:35.111243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae12e5-9d32-4176-84a3-9fce527021aa None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:35.171785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:35.210484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae12e5-9d32-4176-84a3-9fce527021aa None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:35.246236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aadab8-e223-4e1b-98cd-3ef5c5a32a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:35.246887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aadab8-e223-4e1b-98cd-3ef5c5a32a3a None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:35.247162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aadab8-e223-4e1b-98cd-3ef5c5a32a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:35.247468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aadab8-e223-4e1b-98cd-3ef5c5a32a3a None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:35.248108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aadab8-e223-4e1b-98cd-3ef5c5a32a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:35.248411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aadab8-e223-4e1b-98cd-3ef5c5a32a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:35.249783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aadab8-e223-4e1b-98cd-3ef5c5a32a3a None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:35.262598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 605/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:35.269558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60a44d-d842-4d24-a380-14ac695bdd6e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:35.339922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:35.370709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60a44d-d842-4d24-a380-14ac695bdd6e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:35.404227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c4b13-27a2-4a61-a5ac-41cce3493ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:35.404854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c4b13-27a2-4a61-a5ac-41cce3493ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:35.405142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c4b13-27a2-4a61-a5ac-41cce3493ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:35.405416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c4b13-27a2-4a61-a5ac-41cce3493ee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:35.412064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c4b13-27a2-4a61-a5ac-41cce3493ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:35.413501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c4b13-27a2-4a61-a5ac-41cce3493ee5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-dd7c4b13-27a2-4a61-a5ac-41cce3493ee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:39:35.426505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:35.427625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:35.428545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:39:35.428545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:39:35.428545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:39:35.428545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:39:35.428545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:39:35.428545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:39:35.428545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:35.428545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:35.428545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 612/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:35.433597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aadab8-e223-4e1b-98cd-3ef5c5a32a3a None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:35.532381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aadab8-e223-4e1b-98cd-3ef5c5a32a3a None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:35.555541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:35.567660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca309f-0a91-43c7-8344-0dae13f8dcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:35.568287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca309f-0a91-43c7-8344-0dae13f8dcf2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:35.568575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca309f-0a91-43c7-8344-0dae13f8dcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:35.568846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca309f-0a91-43c7-8344-0dae13f8dcf2 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:35.569523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca309f-0a91-43c7-8344-0dae13f8dcf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:35.569827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca309f-0a91-43c7-8344-0dae13f8dcf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:35.571539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca309f-0a91-43c7-8344-0dae13f8dcf2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:35.583800 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 606/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:35.590030 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c4b13-27a2-4a61-a5ac-41cce3493ee5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:35.693302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c4b13-27a2-4a61-a5ac-41cce3493ee5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:35.720135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:35.725955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d172e3b-a7d4-4299-aa5b-321471b90ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:35.726563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d172e3b-a7d4-4299-aa5b-321471b90ffe None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:35.726842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d172e3b-a7d4-4299-aa5b-321471b90ffe None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:35.727115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d172e3b-a7d4-4299-aa5b-321471b90ffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:35.727870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d172e3b-a7d4-4299-aa5b-321471b90ffe None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=36bd5aef3c034c41be036c4cc9eed376) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:35.728178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d172e3b-a7d4-4299-aa5b-321471b90ffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:35.729646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d172e3b-a7d4-4299-aa5b-321471b90ffe None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:35.734967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 613/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:39:35 2022] GET /identity/v3/role_assignments?user.id=36bd5aef3c034c41be036c4cc9eed376&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:37.638101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab220b-df77-4e93-bf80-908ac4af400d None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:37.638596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab220b-df77-4e93-bf80-908ac4af400d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:37.638596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab220b-df77-4e93-bf80-908ac4af400d None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:37.639939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 607/1220] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:39:37.646111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7c050-d85c-441e-9b29-fdbdbbdf34fa None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:37.646537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7c050-d85c-441e-9b29-fdbdbbdf34fa None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:37.646660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7c050-d85c-441e-9b29-fdbdbbdf34fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:37.664527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-45d7c050-d85c-441e-9b29-fdbdbbdf34fa None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:39:37.665707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-45d7c050-d85c-441e-9b29-fdbdbbdf34fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:39:37.736491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 614/1221] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:39:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:39:38.013275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab220b-df77-4e93-bf80-908ac4af400d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:38.119760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab220b-df77-4e93-bf80-908ac4af400d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:38.153602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c1e7-53f0-4540-bf61-47bdeecb16ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:38.154219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c1e7-53f0-4540-bf61-47bdeecb16ab None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:38.154499 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c1e7-53f0-4540-bf61-47bdeecb16ab None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:38.154773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6c1e7-53f0-4540-bf61-47bdeecb16ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:38.164736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6c1e7-53f0-4540-bf61-47bdeecb16ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-b2d6c1e7-53f0-4540-bf61-47bdeecb16ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:39:38.169819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:38.170895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:38.172158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 608/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:39:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:38.177186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7c050-d85c-441e-9b29-fdbdbbdf34fa None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:38.274918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7c050-d85c-441e-9b29-fdbdbbdf34fa None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:38.299007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:38.309438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5667a-94b6-4d61-9ef6-c872f3ad3222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:38.310044 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5667a-94b6-4d61-9ef6-c872f3ad3222 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:38.310321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5667a-94b6-4d61-9ef6-c872f3ad3222 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:38.310591 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5667a-94b6-4d61-9ef6-c872f3ad3222 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:38.311250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5667a-94b6-4d61-9ef6-c872f3ad3222 None admin] RBAC: Adding query filter params (name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:38.311589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5667a-94b6-4d61-9ef6-c872f3ad3222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:38.312987 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5667a-94b6-4d61-9ef6-c872f3ad3222 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:38.321235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 615/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:39:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:38.326921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c1e7-53f0-4540-bf61-47bdeecb16ab None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:38.375441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:38.432195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6c1e7-53f0-4540-bf61-47bdeecb16ab None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:38.466331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eba97f-eba5-4d12-8bd0-592318e5d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:38.466939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba97f-eba5-4d12-8bd0-592318e5d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:38.467214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba97f-eba5-4d12-8bd0-592318e5d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:38.467508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba97f-eba5-4d12-8bd0-592318e5d2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:38.478829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eba97f-eba5-4d12-8bd0-592318e5d2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:38.482471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eba97f-eba5-4d12-8bd0-592318e5d2b3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-f1eba97f-eba5-4d12-8bd0-592318e5d2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:38.494886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:38.496049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:38.497333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:38.497333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:38.497333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:38.497333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 609/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:38.502489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5667a-94b6-4d61-9ef6-c872f3ad3222 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:38.600763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5667a-94b6-4d61-9ef6-c872f3ad3222 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:38.634645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467de0-e755-4867-a642-9a25ba7eb2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:38.635242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467de0-e755-4867-a642-9a25ba7eb2dd None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:38.635569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467de0-e755-4867-a642-9a25ba7eb2dd None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:38.635826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467de0-e755-4867-a642-9a25ba7eb2dd None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:38.636458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467de0-e755-4867-a642-9a25ba7eb2dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:38.636761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467de0-e755-4867-a642-9a25ba7eb2dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:38.638111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467de0-e755-4867-a642-9a25ba7eb2dd None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:38.650023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 616/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:38.655844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eba97f-eba5-4d12-8bd0-592318e5d2b3 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:38.750056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:38.757308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eba97f-eba5-4d12-8bd0-592318e5d2b3 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:38.790446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f2e37-6b3e-4582-9910-5165d9c39c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:38.791064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2e37-6b3e-4582-9910-5165d9c39c04 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:38.791372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2e37-6b3e-4582-9910-5165d9c39c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:38.791649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f2e37-6b3e-4582-9910-5165d9c39c04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:38.799420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f2e37-6b3e-4582-9910-5165d9c39c04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:38.800845 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f2e37-6b3e-4582-9910-5165d9c39c04 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-5d1f2e37-6b3e-4582-9910-5165d9c39c04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:39:38.812125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:38.813245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:38.814247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 610/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:38.819144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467de0-e755-4867-a642-9a25ba7eb2dd None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:38.867624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:38.918241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467de0-e755-4867-a642-9a25ba7eb2dd None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:38.951589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321afb-183d-487e-853a-641748303246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:38.952194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321afb-183d-487e-853a-641748303246 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:38.952512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321afb-183d-487e-853a-641748303246 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:38.952846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321afb-183d-487e-853a-641748303246 None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:38.953575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13321afb-183d-487e-853a-641748303246 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:38.953884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13321afb-183d-487e-853a-641748303246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:38.955354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13321afb-183d-487e-853a-641748303246 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:38.972758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 617/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 07:39:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:38.978664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f2e37-6b3e-4582-9910-5165d9c39c04 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:39.078460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f2e37-6b3e-4582-9910-5165d9c39c04 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:39.112454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c3f5e-cdcb-4b76-a155-1c76e18f6836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:39.113074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c3f5e-cdcb-4b76-a155-1c76e18f6836 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:39.113354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c3f5e-cdcb-4b76-a155-1c76e18f6836 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:39.113630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c3f5e-cdcb-4b76-a155-1c76e18f6836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:39.123955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c3f5e-cdcb-4b76-a155-1c76e18f6836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:39.125341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c3f5e-cdcb-4b76-a155-1c76e18f6836 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-942c3f5e-cdcb-4b76-a155-1c76e18f6836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:39.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:39.146097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:39.147224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:39.147224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:39.147224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:39.147224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 611/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:39.147535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321afb-183d-487e-853a-641748303246 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:39.246414 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321afb-183d-487e-853a-641748303246 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:39.249086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:39.279672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc093b-083e-43e2-935b-18a9f5fff006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:39.280284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc093b-083e-43e2-935b-18a9f5fff006 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:39.280552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc093b-083e-43e2-935b-18a9f5fff006 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:39.280824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc093b-083e-43e2-935b-18a9f5fff006 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:39.281457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc093b-083e-43e2-935b-18a9f5fff006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:39.281758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc093b-083e-43e2-935b-18a9f5fff006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:39.283414 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc093b-083e-43e2-935b-18a9f5fff006 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:39.294423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 618/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:39.300660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c3f5e-cdcb-4b76-a155-1c76e18f6836 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:39.309955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:39.400442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c3f5e-cdcb-4b76-a155-1c76e18f6836 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:39.434501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfadc4d-d0d1-4a39-943c-dd4c0c0096ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:39.435111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfadc4d-d0d1-4a39-943c-dd4c0c0096ca None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:39.435414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfadc4d-d0d1-4a39-943c-dd4c0c0096ca None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:39.435684 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfadc4d-d0d1-4a39-943c-dd4c0c0096ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:39.442841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfadc4d-d0d1-4a39-943c-dd4c0c0096ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:39.444289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfadc4d-d0d1-4a39-943c-dd4c0c0096ca None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-8bfadc4d-d0d1-4a39-943c-dd4c0c0096ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:39:39.455255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:39.456352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:39.457466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:39:39.457466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:39:39.457466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:39:39.457466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:39:39.457466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:39:39.457466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:39:39.457466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:39.457466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:39.457466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 612/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:39.462319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc093b-083e-43e2-935b-18a9f5fff006 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:39.564861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc093b-083e-43e2-935b-18a9f5fff006 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:39.599043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83dac2-c1a8-4ddb-8d13-dc040c4f38cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:39.599837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83dac2-c1a8-4ddb-8d13-dc040c4f38cb None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:39.600133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83dac2-c1a8-4ddb-8d13-dc040c4f38cb None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:39.600391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83dac2-c1a8-4ddb-8d13-dc040c4f38cb None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:39.601154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83dac2-c1a8-4ddb-8d13-dc040c4f38cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:39.601461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83dac2-c1a8-4ddb-8d13-dc040c4f38cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:39.603671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83dac2-c1a8-4ddb-8d13-dc040c4f38cb None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:39.617202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 619/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:39:39.623224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfadc4d-d0d1-4a39-943c-dd4c0c0096ca None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:39.691482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:39.726027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfadc4d-d0d1-4a39-943c-dd4c0c0096ca None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:39.759448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9eca5-e9df-4a99-b886-4f7e43633eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:39.760091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9eca5-e9df-4a99-b886-4f7e43633eb3 None admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:39.760377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9eca5-e9df-4a99-b886-4f7e43633eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:39.760647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9eca5-e9df-4a99-b886-4f7e43633eb3 None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/36bd5aef3c034c41be036c4cc9eed376/roles/f9846b0a2b8b45739e904a66fad55771` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:39.775939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9eca5-e9df-4a99-b886-4f7e43633eb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=36bd5aef3c034c41be036c4cc9eed376, role_id=f9846b0a2b8b45739e904a66fad55771)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:39.777388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9eca5-e9df-4a99-b886-4f7e43633eb3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:39.867974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 613/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:39:39 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/36bd5aef3c034c41be036c4cc9eed376/roles/f9846b0a2b8b45739e904a66fad55771 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:39:41.750800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c42d2-8b00-4cec-8d68-873aeab50787 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:41.751361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c42d2-8b00-4cec-8d68-873aeab50787 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:41.751361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c42d2-8b00-4cec-8d68-873aeab50787 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:41.752722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 620/1233] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:39:41.758937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ff16-cd4f-4a68-ae96-05ad663457f9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:41.759355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ff16-cd4f-4a68-ae96-05ad663457f9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:41.759539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ff16-cd4f-4a68-ae96-05ad663457f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:41.777170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3d65ff16-cd4f-4a68-ae96-05ad663457f9 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:39:41.778341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3d65ff16-cd4f-4a68-ae96-05ad663457f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:39:41.845330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 614/1234] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:39:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:39:42.126704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c42d2-8b00-4cec-8d68-873aeab50787 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:42.152174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:42.225293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c42d2-8b00-4cec-8d68-873aeab50787 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:42.257089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2038436-c48b-4272-822f-2aab9520908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:42.257712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2038436-c48b-4272-822f-2aab9520908d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:42.257988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2038436-c48b-4272-822f-2aab9520908d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:42.258255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2038436-c48b-4272-822f-2aab9520908d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:42.268439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2038436-c48b-4272-822f-2aab9520908d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-d2038436-c48b-4272-822f-2aab9520908d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:39:42.273052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:42.274134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:42.275164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 621/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 24 07:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:42.280371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65ff16-cd4f-4a68-ae96-05ad663457f9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:42.327553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:42.379959 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65ff16-cd4f-4a68-ae96-05ad663457f9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:42.415946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33990b78-de18-4f8f-91f6-937ef29f3e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:42.416556 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33990b78-de18-4f8f-91f6-937ef29f3e14 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:42.417089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33990b78-de18-4f8f-91f6-937ef29f3e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:42.417358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33990b78-de18-4f8f-91f6-937ef29f3e14 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:42.418913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33990b78-de18-4f8f-91f6-937ef29f3e14 None admin] RBAC: Adding query filter params (name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:42.418913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33990b78-de18-4f8f-91f6-937ef29f3e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:42.420156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33990b78-de18-4f8f-91f6-937ef29f3e14 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:42.429382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 615/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 24 07:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:42.435270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2038436-c48b-4272-822f-2aab9520908d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:42.521961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:42.538038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2038436-c48b-4272-822f-2aab9520908d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:42.572393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adecae-6a54-4c82-aa0b-ddedae1d49fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:42.573028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adecae-6a54-4c82-aa0b-ddedae1d49fc None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:42.573317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adecae-6a54-4c82-aa0b-ddedae1d49fc None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:42.573593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adecae-6a54-4c82-aa0b-ddedae1d49fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:42.584655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adecae-6a54-4c82-aa0b-ddedae1d49fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:42.586099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adecae-6a54-4c82-aa0b-ddedae1d49fc None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-30adecae-6a54-4c82-aa0b-ddedae1d49fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:42.600811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:42.601908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:42.602870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:42.602870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:42.602870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:42.602870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 622/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:42.607924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33990b78-de18-4f8f-91f6-937ef29f3e14 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:42.711907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33990b78-de18-4f8f-91f6-937ef29f3e14 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:42.722063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:42.748665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704517cc-6704-4716-a053-984561ffd713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:42.749249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704517cc-6704-4716-a053-984561ffd713 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:42.749522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704517cc-6704-4716-a053-984561ffd713 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:42.749788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704517cc-6704-4716-a053-984561ffd713 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:42.750416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704517cc-6704-4716-a053-984561ffd713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:42.750715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704517cc-6704-4716-a053-984561ffd713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:42.752559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704517cc-6704-4716-a053-984561ffd713 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:42.763905 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 616/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:42.770124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adecae-6a54-4c82-aa0b-ddedae1d49fc None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:42.870293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adecae-6a54-4c82-aa0b-ddedae1d49fc None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:42.903232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a664de6-c5d0-41f4-bbbf-fb2fa695a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:42.903877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664de6-c5d0-41f4-bbbf-fb2fa695a554 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:42.904152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664de6-c5d0-41f4-bbbf-fb2fa695a554 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:42.904418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664de6-c5d0-41f4-bbbf-fb2fa695a554 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:42.907023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:42.912960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a664de6-c5d0-41f4-bbbf-fb2fa695a554 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:42.914403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a664de6-c5d0-41f4-bbbf-fb2fa695a554 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-8a664de6-c5d0-41f4-bbbf-fb2fa695a554 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:39:42.926158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:42.927326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:42.928547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 623/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:42.933236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704517cc-6704-4716-a053-984561ffd713 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:43.031715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704517cc-6704-4716-a053-984561ffd713 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:43.068083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c883b-2e0e-4808-a6c7-9499ec6b05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:43.068709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c883b-2e0e-4808-a6c7-9499ec6b05d0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:43.068991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c883b-2e0e-4808-a6c7-9499ec6b05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:43.069262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c883b-2e0e-4808-a6c7-9499ec6b05d0 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:43.069974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c883b-2e0e-4808-a6c7-9499ec6b05d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:43.070306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c883b-2e0e-4808-a6c7-9499ec6b05d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:43.071773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c883b-2e0e-4808-a6c7-9499ec6b05d0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:43.088669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 617/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 07:39:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:43.094627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a664de6-c5d0-41f4-bbbf-fb2fa695a554 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:43.197942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a664de6-c5d0-41f4-bbbf-fb2fa695a554 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:43.232243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8a05-be85-41f7-accc-44d2292ce610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:43.232839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8a05-be85-41f7-accc-44d2292ce610 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:43.233127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8a05-be85-41f7-accc-44d2292ce610 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:43.233405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8a05-be85-41f7-accc-44d2292ce610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:43.296204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:43.303519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a8a05-be85-41f7-accc-44d2292ce610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:43.306848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a8a05-be85-41f7-accc-44d2292ce610 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:43.404544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 624/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:39:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:39:43.410958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c883b-2e0e-4808-a6c7-9499ec6b05d0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:43.440073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:43.508993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c883b-2e0e-4808-a6c7-9499ec6b05d0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:43.543279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547e3d8-9476-4316-a441-51ed3365d0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:43.543921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547e3d8-9476-4316-a441-51ed3365d0e2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:43.544219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547e3d8-9476-4316-a441-51ed3365d0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:43.544485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547e3d8-9476-4316-a441-51ed3365d0e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:43.554266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547e3d8-9476-4316-a441-51ed3365d0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:43.555669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547e3d8-9476-4316-a441-51ed3365d0e2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-0547e3d8-9476-4316-a441-51ed3365d0e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:43.570075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:43.574533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:43.575760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:43.575760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:43.575760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:43.575760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 618/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:43.577081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8a05-be85-41f7-accc-44d2292ce610 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:43.673727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:43.679621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8a05-be85-41f7-accc-44d2292ce610 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:43.714026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c03388-2f91-46d3-b8f5-622dbc8daa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:43.714623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c03388-2f91-46d3-b8f5-622dbc8daa8e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:43.714914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c03388-2f91-46d3-b8f5-622dbc8daa8e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:43.715195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c03388-2f91-46d3-b8f5-622dbc8daa8e None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:43.715870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c03388-2f91-46d3-b8f5-622dbc8daa8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:43.716294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c03388-2f91-46d3-b8f5-622dbc8daa8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:43.717671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c03388-2f91-46d3-b8f5-622dbc8daa8e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:43.728830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 625/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:43.734519 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547e3d8-9476-4316-a441-51ed3365d0e2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:43.813128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:43.834575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547e3d8-9476-4316-a441-51ed3365d0e2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:43.867834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a77a13-0334-4098-a02e-84fce1a1660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:43.868454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a77a13-0334-4098-a02e-84fce1a1660d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:43.868736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a77a13-0334-4098-a02e-84fce1a1660d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:43.869009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a77a13-0334-4098-a02e-84fce1a1660d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:43.875414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a77a13-0334-4098-a02e-84fce1a1660d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:43.876953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a77a13-0334-4098-a02e-84fce1a1660d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-81a77a13-0334-4098-a02e-84fce1a1660d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:39:43.887907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:43.888988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:43.890311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:39:43.890311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:39:43.890311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:39:43.890311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:39:43.890311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:39:43.890311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:39:43.890311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:43.890311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:43.890311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 619/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:43.896361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c03388-2f91-46d3-b8f5-622dbc8daa8e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:43.997987 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c03388-2f91-46d3-b8f5-622dbc8daa8e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:44.030710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17b9b5-a2ae-42f9-a0a2-a1e94e0ceed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:44.031325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17b9b5-a2ae-42f9-a0a2-a1e94e0ceed9 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:44.031606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17b9b5-a2ae-42f9-a0a2-a1e94e0ceed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:44.031873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17b9b5-a2ae-42f9-a0a2-a1e94e0ceed9 None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:44.032624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17b9b5-a2ae-42f9-a0a2-a1e94e0ceed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:44.032925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17b9b5-a2ae-42f9-a0a2-a1e94e0ceed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:44.034344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17b9b5-a2ae-42f9-a0a2-a1e94e0ceed9 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:44.049304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 626/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:44.055696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a77a13-0334-4098-a02e-84fce1a1660d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:44.157723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a77a13-0334-4098-a02e-84fce1a1660d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:44.192128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6924c39-f715-4c2a-8bd8-ce3b35fbedd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:44.192864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6924c39-f715-4c2a-8bd8-ce3b35fbedd3 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:44.193149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6924c39-f715-4c2a-8bd8-ce3b35fbedd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:44.193418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6924c39-f715-4c2a-8bd8-ce3b35fbedd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:44.194130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6924c39-f715-4c2a-8bd8-ce3b35fbedd3 None admin] RBAC: Adding query filter params (role.id=f9846b0a2b8b45739e904a66fad55771, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=36bd5aef3c034c41be036c4cc9eed376) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:44.194434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6924c39-f715-4c2a-8bd8-ce3b35fbedd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:44.195892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6924c39-f715-4c2a-8bd8-ce3b35fbedd3 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:44.201510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 620/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:39:44 2022] GET /identity/v3/role_assignments?user.id=36bd5aef3c034c41be036c4cc9eed376&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=f9846b0a2b8b45739e904a66fad55771 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:39:46.196371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fedbe-eefa-4ad4-8565-e3f530c7e15a None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:46.196927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fedbe-eefa-4ad4-8565-e3f530c7e15a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:46.196927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fedbe-eefa-4ad4-8565-e3f530c7e15a None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:46.198274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 627/1247] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:39:46.203641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a6d12-eb33-4126-b3a6-3d558d31b0f2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:46.204088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a6d12-eb33-4126-b3a6-3d558d31b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:46.206528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a6d12-eb33-4126-b3a6-3d558d31b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:46.210687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:46.222643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-384a6d12-eb33-4126-b3a6-3d558d31b0f2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:39:46.223847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-384a6d12-eb33-4126-b3a6-3d558d31b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:39:46.289534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 621/1248] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:39:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:39:46.568186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fedbe-eefa-4ad4-8565-e3f530c7e15a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:46.586468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:46.671083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fedbe-eefa-4ad4-8565-e3f530c7e15a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:46.705259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd0de9-6822-482f-8d22-a00f3118ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:46.705887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0de9-6822-482f-8d22-a00f3118ca4b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:46.706168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0de9-6822-482f-8d22-a00f3118ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:46.706438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd0de9-6822-482f-8d22-a00f3118ca4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:46.716792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd0de9-6822-482f-8d22-a00f3118ca4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-28bd0de9-6822-482f-8d22-a00f3118ca4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:39:46.722333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:46.723525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:46.724792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 628/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:46.729562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a6d12-eb33-4126-b3a6-3d558d31b0f2 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:46.831125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a6d12-eb33-4126-b3a6-3d558d31b0f2 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:46.861029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:46.865919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b7425-cbc2-4102-acbe-a3cd9c721780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:46.866522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b7425-cbc2-4102-acbe-a3cd9c721780 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:46.866804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b7425-cbc2-4102-acbe-a3cd9c721780 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:46.867078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b7425-cbc2-4102-acbe-a3cd9c721780 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:46.867760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b7425-cbc2-4102-acbe-a3cd9c721780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:46.868063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b7425-cbc2-4102-acbe-a3cd9c721780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:46.869420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b7425-cbc2-4102-acbe-a3cd9c721780 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:46.877454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 622/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:46.883255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd0de9-6822-482f-8d22-a00f3118ca4b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:46.963224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:46.986038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd0de9-6822-482f-8d22-a00f3118ca4b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:47.020391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0566fe-7b0b-464d-b22d-54cd1de7d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:47.021054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0566fe-7b0b-464d-b22d-54cd1de7d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:47.021339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0566fe-7b0b-464d-b22d-54cd1de7d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:47.021619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0566fe-7b0b-464d-b22d-54cd1de7d3e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:47.031225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0566fe-7b0b-464d-b22d-54cd1de7d3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:47.033794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0566fe-7b0b-464d-b22d-54cd1de7d3e5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-eb0566fe-7b0b-464d-b22d-54cd1de7d3e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:47.048574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:47.050363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:47.052364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:47.052364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:47.052364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:47.052364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 629/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:47.055670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b7425-cbc2-4102-acbe-a3cd9c721780 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:47.153860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b7425-cbc2-4102-acbe-a3cd9c721780 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:47.185745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874e52-d13a-4730-9d91-dc15d5c4eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:47.186350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874e52-d13a-4730-9d91-dc15d5c4eea1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:47.186634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874e52-d13a-4730-9d91-dc15d5c4eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:47.186898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874e52-d13a-4730-9d91-dc15d5c4eea1 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:47.187546 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874e52-d13a-4730-9d91-dc15d5c4eea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:47.187843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874e52-d13a-4730-9d91-dc15d5c4eea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:47.189929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874e52-d13a-4730-9d91-dc15d5c4eea1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:47.201547 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 623/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:47.208143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0566fe-7b0b-464d-b22d-54cd1de7d3e5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:47.308909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0566fe-7b0b-464d-b22d-54cd1de7d3e5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:47.335016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:47.344412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c9f2-4010-4584-81a7-7a3aa79f3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:47.345088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c9f2-4010-4584-81a7-7a3aa79f3c14 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:47.345364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c9f2-4010-4584-81a7-7a3aa79f3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:47.345632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c9f2-4010-4584-81a7-7a3aa79f3c14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:47.353052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44c9f2-4010-4584-81a7-7a3aa79f3c14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:47.354490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44c9f2-4010-4584-81a7-7a3aa79f3c14 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-0a44c9f2-4010-4584-81a7-7a3aa79f3c14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:39:47.365435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:47.366602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:47.367785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 630/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:47.372456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874e52-d13a-4730-9d91-dc15d5c4eea1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:47.428560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:47.471445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874e52-d13a-4730-9d91-dc15d5c4eea1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:47.506652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf7ee-9d49-4612-88ac-4228610f9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:47.507244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf7ee-9d49-4612-88ac-4228610f9f00 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:47.507552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf7ee-9d49-4612-88ac-4228610f9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:47.507821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bf7ee-9d49-4612-88ac-4228610f9f00 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:47.508530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf7ee-9d49-4612-88ac-4228610f9f00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:47.508831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf7ee-9d49-4612-88ac-4228610f9f00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:47.510234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bf7ee-9d49-4612-88ac-4228610f9f00 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:47.527262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 624/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 07:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:47.533388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c9f2-4010-4584-81a7-7a3aa79f3c14 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:47.638006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c9f2-4010-4584-81a7-7a3aa79f3c14 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:47.670383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3682c2-131c-4ddf-af65-440a34a9c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:47.670978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3682c2-131c-4ddf-af65-440a34a9c24f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:47.671252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3682c2-131c-4ddf-af65-440a34a9c24f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:47.671571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3682c2-131c-4ddf-af65-440a34a9c24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:47.727666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:47.740475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3682c2-131c-4ddf-af65-440a34a9c24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:47.741934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3682c2-131c-4ddf-af65-440a34a9c24f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:47.839869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 631/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:39:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:39:47.846690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf7ee-9d49-4612-88ac-4228610f9f00 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:47.945119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bf7ee-9d49-4612-88ac-4228610f9f00 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:47.958363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:47.978541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f4c2a-a27e-45af-b9f2-c910f75b2672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:47.979092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f4c2a-a27e-45af-b9f2-c910f75b2672 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:47.979400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f4c2a-a27e-45af-b9f2-c910f75b2672 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:47.979669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f4c2a-a27e-45af-b9f2-c910f75b2672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:47.989155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f4c2a-a27e-45af-b9f2-c910f75b2672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:47.990565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f4c2a-a27e-45af-b9f2-c910f75b2672 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-2b0f4c2a-a27e-45af-b9f2-c910f75b2672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:48.004820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:48.005912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:48.006793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:48.006793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:48.006793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:48.006793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 625/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:48.011718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3682c2-131c-4ddf-af65-440a34a9c24f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:48.101890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:48.113429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3682c2-131c-4ddf-af65-440a34a9c24f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:48.147554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad77bb-7ca0-4f36-abae-7799807712ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:48.148147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad77bb-7ca0-4f36-abae-7799807712ea None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:48.148455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad77bb-7ca0-4f36-abae-7799807712ea None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:48.148723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad77bb-7ca0-4f36-abae-7799807712ea None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:48.149372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad77bb-7ca0-4f36-abae-7799807712ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:48.149652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad77bb-7ca0-4f36-abae-7799807712ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:48.151026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad77bb-7ca0-4f36-abae-7799807712ea None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:48.162154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 632/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:48.168187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f4c2a-a27e-45af-b9f2-c910f75b2672 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:48.267037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f4c2a-a27e-45af-b9f2-c910f75b2672 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:48.300192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6e7bc-d662-4436-9b5f-851eac641f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:48.300795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6e7bc-d662-4436-9b5f-851eac641f5f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:48.301068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6e7bc-d662-4436-9b5f-851eac641f5f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:48.301334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6e7bc-d662-4436-9b5f-851eac641f5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:48.307711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6e7bc-d662-4436-9b5f-851eac641f5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:48.309127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6e7bc-d662-4436-9b5f-851eac641f5f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-e6b6e7bc-d662-4436-9b5f-851eac641f5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:39:48.319950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:48.320986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:48.321917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:39:48.321917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:39:48.321917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:39:48.321917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:39:48.321917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:39:48.321917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:39:48.321917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:48.321917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:48.321917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 626/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:48.327236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad77bb-7ca0-4f36-abae-7799807712ea None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:48.437339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad77bb-7ca0-4f36-abae-7799807712ea None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:48.470998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c782a65-7960-48cb-9255-b50b4627a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:48.471637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c782a65-7960-48cb-9255-b50b4627a85d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:48.471947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c782a65-7960-48cb-9255-b50b4627a85d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:48.472190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c782a65-7960-48cb-9255-b50b4627a85d None admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:48.472874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c782a65-7960-48cb-9255-b50b4627a85d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:48.473179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c782a65-7960-48cb-9255-b50b4627a85d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:48.474605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c782a65-7960-48cb-9255-b50b4627a85d None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:48.486278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 633/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:48.492568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6e7bc-d662-4436-9b5f-851eac641f5f None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:48.518960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:48.591780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6e7bc-d662-4436-9b5f-851eac641f5f None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:48.624496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c45d-7fe1-4c38-99cf-d18bada22e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:48.625133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c45d-7fe1-4c38-99cf-d18bada22e72 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:48.625390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c45d-7fe1-4c38-99cf-d18bada22e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:48.626259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c45d-7fe1-4c38-99cf-d18bada22e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:48.626967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2c45d-7fe1-4c38-99cf-d18bada22e72 None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=36bd5aef3c034c41be036c4cc9eed376) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:48.627270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2c45d-7fe1-4c38-99cf-d18bada22e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:48.628710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2c45d-7fe1-4c38-99cf-d18bada22e72 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:48.633987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 627/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:39:48 2022] GET /identity/v3/role_assignments?user.id=36bd5aef3c034c41be036c4cc9eed376&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:39:50.514065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f3e41-cff0-40f5-b0ee-27d247bf8081 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:50.514637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f3e41-cff0-40f5-b0ee-27d247bf8081 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:50.514637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f3e41-cff0-40f5-b0ee-27d247bf8081 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:50.516558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 634/1261] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:39:50.522031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cac902-5fb0-40aa-b8ad-22f5420cf471 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:50.522457 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cac902-5fb0-40aa-b8ad-22f5420cf471 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:50.522587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cac902-5fb0-40aa-b8ad-22f5420cf471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:50.542119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-06cac902-5fb0-40aa-b8ad-22f5420cf471 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:39:50.543328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-06cac902-5fb0-40aa-b8ad-22f5420cf471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:39:50.610951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 628/1262] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:39:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:39:50.889792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f3e41-cff0-40f5-b0ee-27d247bf8081 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:50.901483 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:50.991167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f3e41-cff0-40f5-b0ee-27d247bf8081 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:51.023872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a130-8c41-49ac-a29a-c5314fc1889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:51.024510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a130-8c41-49ac-a29a-c5314fc1889d None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:51.024795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a130-8c41-49ac-a29a-c5314fc1889d None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:51.025071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9a130-8c41-49ac-a29a-c5314fc1889d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:51.036711 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9a130-8c41-49ac-a29a-c5314fc1889d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-e3e9a130-8c41-49ac-a29a-c5314fc1889d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:39:51.041975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:51.043057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:51.044329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 635/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:39:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:51.049849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cac902-5fb0-40aa-b8ad-22f5420cf471 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:51.068365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:51.147216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cac902-5fb0-40aa-b8ad-22f5420cf471 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:51.183698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ac44d-ea1a-4bbb-8a0b-6f6c75f5dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:51.184304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ac44d-ea1a-4bbb-8a0b-6f6c75f5dbf6 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:51.184591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ac44d-ea1a-4bbb-8a0b-6f6c75f5dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:51.184871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ac44d-ea1a-4bbb-8a0b-6f6c75f5dbf6 None admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:51.185525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ac44d-ea1a-4bbb-8a0b-6f6c75f5dbf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:51.185848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ac44d-ea1a-4bbb-8a0b-6f6c75f5dbf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:51.187210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ac44d-ea1a-4bbb-8a0b-6f6c75f5dbf6 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:51.196178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 629/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:39:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:51.201991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a130-8c41-49ac-a29a-c5314fc1889d None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:51.269520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:51.303887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9a130-8c41-49ac-a29a-c5314fc1889d None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:51.337192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b572a5-9828-4dba-88b3-cf54bec3703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:51.338130 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b572a5-9828-4dba-88b3-cf54bec3703f None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:51.338845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b572a5-9828-4dba-88b3-cf54bec3703f None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:51.339134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b572a5-9828-4dba-88b3-cf54bec3703f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:51.350472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b572a5-9828-4dba-88b3-cf54bec3703f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:51.352008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b572a5-9828-4dba-88b3-cf54bec3703f None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-63b572a5-9828-4dba-88b3-cf54bec3703f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:51.366232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:51.367212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:51.368542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:51.368542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:51.368542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:51.368542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 636/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:51.373179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ac44d-ea1a-4bbb-8a0b-6f6c75f5dbf6 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:51.454371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:51.472683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ac44d-ea1a-4bbb-8a0b-6f6c75f5dbf6 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:51.506429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575eabe-dcd6-46c8-9b06-e40892eff689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:51.507007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575eabe-dcd6-46c8-9b06-e40892eff689 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:51.507299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575eabe-dcd6-46c8-9b06-e40892eff689 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:51.507588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575eabe-dcd6-46c8-9b06-e40892eff689 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:51.508210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575eabe-dcd6-46c8-9b06-e40892eff689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:51.508504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575eabe-dcd6-46c8-9b06-e40892eff689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:51.509829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575eabe-dcd6-46c8-9b06-e40892eff689 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:51.520699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 630/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:51.526471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b572a5-9828-4dba-88b3-cf54bec3703f None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:51.629678 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b572a5-9828-4dba-88b3-cf54bec3703f None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:51.650685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:51.665173 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3bae1-9744-4de3-bbf0-e5e4f26ce717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:51.665794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3bae1-9744-4de3-bbf0-e5e4f26ce717 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:51.666070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3bae1-9744-4de3-bbf0-e5e4f26ce717 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:51.666597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3bae1-9744-4de3-bbf0-e5e4f26ce717 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:51.674422 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3bae1-9744-4de3-bbf0-e5e4f26ce717 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:51.675899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3bae1-9744-4de3-bbf0-e5e4f26ce717 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-2bb3bae1-9744-4de3-bbf0-e5e4f26ce717 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:39:51.686545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:51.687729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:51.689008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 637/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:51.693590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575eabe-dcd6-46c8-9b06-e40892eff689 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:51.796531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575eabe-dcd6-46c8-9b06-e40892eff689 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:51.829794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1d695-d1d7-4914-b17f-584dcb15f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:51.830388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d695-d1d7-4914-b17f-584dcb15f320 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:51.830668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d695-d1d7-4914-b17f-584dcb15f320 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:51.830940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d695-d1d7-4914-b17f-584dcb15f320 None admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:51.831683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1d695-d1d7-4914-b17f-584dcb15f320 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:51.832029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1d695-d1d7-4914-b17f-584dcb15f320 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:51.833445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1d695-d1d7-4914-b17f-584dcb15f320 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:51.842337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:51.850618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 631/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 07:39:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:51.856463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3bae1-9744-4de3-bbf0-e5e4f26ce717 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:51.955655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3bae1-9744-4de3-bbf0-e5e4f26ce717 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:51.989692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33d10-129f-4286-80fd-d658b53a64a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:51.990317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33d10-129f-4286-80fd-d658b53a64a5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:51.990595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33d10-129f-4286-80fd-d658b53a64a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:51.990873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33d10-129f-4286-80fd-d658b53a64a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:52.002245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df33d10-129f-4286-80fd-d658b53a64a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:52.003759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df33d10-129f-4286-80fd-d658b53a64a5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-5df33d10-129f-4286-80fd-d658b53a64a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:52.017954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:52.019097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:52.020276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:52.020276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:52.020276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:52.020276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 638/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:52.025080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1d695-d1d7-4914-b17f-584dcb15f320 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:52.127195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1d695-d1d7-4914-b17f-584dcb15f320 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:52.160200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebf8d-cdcf-47ed-9378-d8f6e65b00a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:52.160792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebf8d-cdcf-47ed-9378-d8f6e65b00a1 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:52.161070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebf8d-cdcf-47ed-9378-d8f6e65b00a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:52.161338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebf8d-cdcf-47ed-9378-d8f6e65b00a1 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:52.161965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebf8d-cdcf-47ed-9378-d8f6e65b00a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:52.162264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebf8d-cdcf-47ed-9378-d8f6e65b00a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:52.163654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebf8d-cdcf-47ed-9378-d8f6e65b00a1 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:52.175944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 632/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:52.181779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33d10-129f-4286-80fd-d658b53a64a5 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:52.214767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:52.282788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33d10-129f-4286-80fd-d658b53a64a5 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:52.317029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9196-0ff1-4da6-b34d-642a3353cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:52.317770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9196-0ff1-4da6-b34d-642a3353cb83 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:52.318050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9196-0ff1-4da6-b34d-642a3353cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:52.318319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9196-0ff1-4da6-b34d-642a3353cb83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:52.324775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9196-0ff1-4da6-b34d-642a3353cb83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:52.326211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9196-0ff1-4da6-b34d-642a3353cb83 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-33ce9196-0ff1-4da6-b34d-642a3353cb83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:39:52.342336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:52.343528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:52.345805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:39:52.345805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:39:52.345805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:39:52.345805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:39:52.345805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:39:52.345805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:39:52.345805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:52.345805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:52.345805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 639/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:52.349646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebf8d-cdcf-47ed-9378-d8f6e65b00a1 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:52.408580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:52.449134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebf8d-cdcf-47ed-9378-d8f6e65b00a1 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:52.483862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58f6b6-1f8e-429c-ae9c-3a848db0b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:52.484459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58f6b6-1f8e-429c-ae9c-3a848db0b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:52.484997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58f6b6-1f8e-429c-ae9c-3a848db0b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:52.485277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58f6b6-1f8e-429c-ae9c-3a848db0b7c2 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:52.485954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58f6b6-1f8e-429c-ae9c-3a848db0b7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:52.486260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58f6b6-1f8e-429c-ae9c-3a848db0b7c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:52.487708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58f6b6-1f8e-429c-ae9c-3a848db0b7c2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:52.499711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 633/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:39:52.506330 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9196-0ff1-4da6-b34d-642a3353cb83 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:52.601227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:52.609776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9196-0ff1-4da6-b34d-642a3353cb83 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:52.643829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5ef7e-1425-48c0-880e-6d24fcbd085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:52.644528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ef7e-1425-48c0-880e-6d24fcbd085e None admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:52.644803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ef7e-1425-48c0-880e-6d24fcbd085e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:52.645075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5ef7e-1425-48c0-880e-6d24fcbd085e None admin] PATH_INFO: `/v3/projects/e5326f878c814478b71a7e9badf70d02/users/36bd5aef3c034c41be036c4cc9eed376/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:52.646976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5ef7e-1425-48c0-880e-6d24fcbd085e None admin] RBAC: Authorizing `identity:create_grant(project_id=e5326f878c814478b71a7e9badf70d02, user_id=36bd5aef3c034c41be036c4cc9eed376, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:52.648518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5ef7e-1425-48c0-880e-6d24fcbd085e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:52.822189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 640/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 24 07:39:52 2022] PUT /identity/v3/projects/e5326f878c814478b71a7e9badf70d02/users/36bd5aef3c034c41be036c4cc9eed376/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:39:54.712005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384e65-4497-4e71-b3b5-3b0b549b7991 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:54.712514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384e65-4497-4e71-b3b5-3b0b549b7991 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:54.712514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384e65-4497-4e71-b3b5-3b0b549b7991 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:54.713785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 634/1274] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:39:54.719751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f32a5b-c9c8-4a91-8d9a-a88d039a64af None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:54.720163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f32a5b-c9c8-4a91-8d9a-a88d039a64af None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:54.720416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f32a5b-c9c8-4a91-8d9a-a88d039a64af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:54.738747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-95f32a5b-c9c8-4a91-8d9a-a88d039a64af None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:39:54.740010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-95f32a5b-c9c8-4a91-8d9a-a88d039a64af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:39:54.805873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 641/1275] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:39:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:39:55.082532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384e65-4497-4e71-b3b5-3b0b549b7991 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:55.184754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384e65-4497-4e71-b3b5-3b0b549b7991 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:55.201348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:55.217863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f8faf-a0e7-4620-8b97-c9e0297d26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:55.218470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f8faf-a0e7-4620-8b97-c9e0297d26f4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:55.219455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f8faf-a0e7-4620-8b97-c9e0297d26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:55.219932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f8faf-a0e7-4620-8b97-c9e0297d26f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:55.229543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f8faf-a0e7-4620-8b97-c9e0297d26f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-b17f8faf-a0e7-4620-8b97-c9e0297d26f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:39:55.234214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:55.235544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:55.241543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 635/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 24 07:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:55.242438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f32a5b-c9c8-4a91-8d9a-a88d039a64af None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:55.322326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:55.340888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f32a5b-c9c8-4a91-8d9a-a88d039a64af None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:55.374128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ee559-3c53-41a3-9b13-7664ea049e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:55.374727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ee559-3c53-41a3-9b13-7664ea049e36 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:55.375622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ee559-3c53-41a3-9b13-7664ea049e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:55.375933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ee559-3c53-41a3-9b13-7664ea049e36 None admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:55.376585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ee559-3c53-41a3-9b13-7664ea049e36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:55.376882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ee559-3c53-41a3-9b13-7664ea049e36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:55.378232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ee559-3c53-41a3-9b13-7664ea049e36 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:55.386061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 642/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 24 07:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:55.392552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f8faf-a0e7-4620-8b97-c9e0297d26f4 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:55.491656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f8faf-a0e7-4620-8b97-c9e0297d26f4 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:55.525616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4700c-7c88-4783-87dc-94e39a52bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:55.526233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4700c-7c88-4783-87dc-94e39a52bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:55.526522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4700c-7c88-4783-87dc-94e39a52bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:55.526802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4700c-7c88-4783-87dc-94e39a52bcf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:55.536599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4700c-7c88-4783-87dc-94e39a52bcf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:55.538025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4700c-7c88-4783-87dc-94e39a52bcf2 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-c0a4700c-7c88-4783-87dc-94e39a52bcf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:55.552728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:55.553829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:55.554940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:55.554940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:55.554940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:55.555437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 636/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:55.559737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ee559-3c53-41a3-9b13-7664ea049e36 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:55.664471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ee559-3c53-41a3-9b13-7664ea049e36 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:55.700787 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bfc57-2c91-492b-a2e1-7551591b2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:55.701455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bfc57-2c91-492b-a2e1-7551591b2d92 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:55.701738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bfc57-2c91-492b-a2e1-7551591b2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:55.702305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bfc57-2c91-492b-a2e1-7551591b2d92 None admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:55.702945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bfc57-2c91-492b-a2e1-7551591b2d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:55.703324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bfc57-2c91-492b-a2e1-7551591b2d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:55.704684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bfc57-2c91-492b-a2e1-7551591b2d92 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:55.716174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 643/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:55.721989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4700c-7c88-4783-87dc-94e39a52bcf2 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:55.753562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:55.820209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4700c-7c88-4783-87dc-94e39a52bcf2 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:55.853656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea426fd-6ab6-47d5-a4aa-1ae212b16bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:55.854265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea426fd-6ab6-47d5-a4aa-1ae212b16bcd None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:55.854545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea426fd-6ab6-47d5-a4aa-1ae212b16bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:55.854818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea426fd-6ab6-47d5-a4aa-1ae212b16bcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:55.862297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea426fd-6ab6-47d5-a4aa-1ae212b16bcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:55.863842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea426fd-6ab6-47d5-a4aa-1ae212b16bcd None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-bea426fd-6ab6-47d5-a4aa-1ae212b16bcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:39:55.875568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:55.876706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:55.878106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 637/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:55.882541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bfc57-2c91-492b-a2e1-7551591b2d92 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:55.886388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:55.981685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bfc57-2c91-492b-a2e1-7551591b2d92 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:56.017870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9f8ba-2568-4b43-8895-df9f942a9f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:56.018526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9f8ba-2568-4b43-8895-df9f942a9f3e None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:56.018808 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9f8ba-2568-4b43-8895-df9f942a9f3e None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:56.019080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9f8ba-2568-4b43-8895-df9f942a9f3e None admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:56.019840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9f8ba-2568-4b43-8895-df9f942a9f3e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:56.020141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9f8ba-2568-4b43-8895-df9f942a9f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:56.021567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9f8ba-2568-4b43-8895-df9f942a9f3e None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:56.039245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 644/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 24 07:39:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:56.045368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea426fd-6ab6-47d5-a4aa-1ae212b16bcd None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:56.134976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:56.144242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea426fd-6ab6-47d5-a4aa-1ae212b16bcd None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:56.178033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1675b3-d8d9-465d-bd35-12cd8491985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:56.178623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1675b3-d8d9-465d-bd35-12cd8491985d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:56.178898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1675b3-d8d9-465d-bd35-12cd8491985d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:56.179165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1675b3-d8d9-465d-bd35-12cd8491985d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:56.246096 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1675b3-d8d9-465d-bd35-12cd8491985d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:56.247506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1675b3-d8d9-465d-bd35-12cd8491985d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:56.337593 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:56.348006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 638/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 24 07:39:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:39:56.354036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9f8ba-2568-4b43-8895-df9f942a9f3e None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:56.415306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:56.455077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9f8ba-2568-4b43-8895-df9f942a9f3e None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:56.491364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a6b55-5855-4286-b63e-16ddffd55b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:56.492022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a6b55-5855-4286-b63e-16ddffd55b10 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:56.492303 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a6b55-5855-4286-b63e-16ddffd55b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:56.492571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a6b55-5855-4286-b63e-16ddffd55b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:56.503593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a6b55-5855-4286-b63e-16ddffd55b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:56.504977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a6b55-5855-4286-b63e-16ddffd55b10 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-9e0a6b55-5855-4286-b63e-16ddffd55b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:39:56.520018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:56.521181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:39:56.522259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:39:56.522259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:39:56.522259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:56.522259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 645/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:56.527139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1675b3-d8d9-465d-bd35-12cd8491985d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:56.630914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1675b3-d8d9-465d-bd35-12cd8491985d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:56.668876 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8dc19-e586-4aec-a2b6-72b1e5409ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:56.669478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8dc19-e586-4aec-a2b6-72b1e5409ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:56.669766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8dc19-e586-4aec-a2b6-72b1e5409ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:56.670040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8dc19-e586-4aec-a2b6-72b1e5409ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:56.670686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8dc19-e586-4aec-a2b6-72b1e5409ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:56.671041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8dc19-e586-4aec-a2b6-72b1e5409ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:56.672583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8dc19-e586-4aec-a2b6-72b1e5409ce4 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:56.683853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 639/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 24 07:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:56.689638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a6b55-5855-4286-b63e-16ddffd55b10 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:56.790457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a6b55-5855-4286-b63e-16ddffd55b10 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:56.803851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:56.823440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7f42a-5594-42f2-bc88-0596d7319f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:56.824056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7f42a-5594-42f2-bc88-0596d7319f2b None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:56.824331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7f42a-5594-42f2-bc88-0596d7319f2b None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:56.824595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7f42a-5594-42f2-bc88-0596d7319f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:56.831554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7f42a-5594-42f2-bc88-0596d7319f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:56.832983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7f42a-5594-42f2-bc88-0596d7319f2b None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application [None req-65d7f42a-5594-42f2-bc88-0596d7319f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:39:56.843731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:56.844783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:56.845892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:39:56.845892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:39:56.845892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:39:56.845892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:39:56.845892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:39:56.845892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:39:56.845892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:39:56.845892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: ERROR keystone.server.flask.application Aug 24 07:39:56.845892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 646/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 24 07:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:56.850855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8dc19-e586-4aec-a2b6-72b1e5409ce4 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:56.900330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:56.949793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8dc19-e586-4aec-a2b6-72b1e5409ce4 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:56.982891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd0bd2-b936-4745-a691-5b73b0fd1240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:56.983510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd0bd2-b936-4745-a691-5b73b0fd1240 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:56.983787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd0bd2-b936-4745-a691-5b73b0fd1240 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:56.984056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd0bd2-b936-4745-a691-5b73b0fd1240 None admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:56.984755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd0bd2-b936-4745-a691-5b73b0fd1240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:56.985062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd0bd2-b936-4745-a691-5b73b0fd1240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:56.986468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd0bd2-b936-4745-a691-5b73b0fd1240 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:56.997951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 640/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 24 07:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:57.004738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7f42a-5594-42f2-bc88-0596d7319f2b None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:57.121737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7f42a-5594-42f2-bc88-0596d7319f2b None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:57.161944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f713863-aba1-47cc-a7d8-104608e113cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:57.162572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713863-aba1-47cc-a7d8-104608e113cd None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:57.162853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713863-aba1-47cc-a7d8-104608e113cd None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:57.163117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713863-aba1-47cc-a7d8-104608e113cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:57.163900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f713863-aba1-47cc-a7d8-104608e113cd None admin] RBAC: Adding query filter params (role.id=c7ce63b9a09b4c318578d01192d287fc, scope.project.id=e5326f878c814478b71a7e9badf70d02, user.id=36bd5aef3c034c41be036c4cc9eed376) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:57.164211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f713863-aba1-47cc-a7d8-104608e113cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:57.165704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f713863-aba1-47cc-a7d8-104608e113cd None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:57.172541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 647/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 24 07:39:57 2022] GET /identity/v3/role_assignments?user.id=36bd5aef3c034c41be036c4cc9eed376&scope.project.id=e5326f878c814478b71a7e9badf70d02&role.id=c7ce63b9a09b4c318578d01192d287fc => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:59.146840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec552500-398b-4c7a-8a8d-246572ef4708 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:59.147412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec552500-398b-4c7a-8a8d-246572ef4708 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:59.147412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec552500-398b-4c7a-8a8d-246572ef4708 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:59.148763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 641/1288] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:39:59.153959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86fb85-6225-4147-9bbe-b7c592800b5d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:59.154344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86fb85-6225-4147-9bbe-b7c592800b5d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:59.154524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86fb85-6225-4147-9bbe-b7c592800b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:59.173444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-7c86fb85-6225-4147-9bbe-b7c592800b5d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:39:59.174736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7c86fb85-6225-4147-9bbe-b7c592800b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:39:59.209066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:59.244860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 648/1289] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:39:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:39:59.523559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec552500-398b-4c7a-8a8d-246572ef4708 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:59.623614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec552500-398b-4c7a-8a8d-246572ef4708 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:59.634676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:39:59.657112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161d834-0f98-4f10-ae81-0611e7f48c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:59.657729 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161d834-0f98-4f10-ae81-0611e7f48c20 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:59.658016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161d834-0f98-4f10-ae81-0611e7f48c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:59.658282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161d834-0f98-4f10-ae81-0611e7f48c20 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:59.658852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161d834-0f98-4f10-ae81-0611e7f48c20 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:59.660248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161d834-0f98-4f10-ae81-0611e7f48c20 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-a161d834-0f98-4f10-ae81-0611e7f48c20 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:39:59.669662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:39:59.670887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:39:59.672973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 642/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:39:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:39:59.677652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86fb85-6225-4147-9bbe-b7c592800b5d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:59.783256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86fb85-6225-4147-9bbe-b7c592800b5d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:59.816671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97aa46-71ea-460b-aa68-65f1031990d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:59.817270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97aa46-71ea-460b-aa68-65f1031990d5 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:59.817544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97aa46-71ea-460b-aa68-65f1031990d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:59.817820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97aa46-71ea-460b-aa68-65f1031990d5 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:59.818439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97aa46-71ea-460b-aa68-65f1031990d5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:59.818737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97aa46-71ea-460b-aa68-65f1031990d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:59.820150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97aa46-71ea-460b-aa68-65f1031990d5 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:59.824929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 649/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 24 07:39:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:39:59.830915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161d834-0f98-4f10-ae81-0611e7f48c20 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:39:59.928662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161d834-0f98-4f10-ae81-0611e7f48c20 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:39:59.960628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b7773-6318-4547-ba45-94e132921f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:39:59.961217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b7773-6318-4547-ba45-94e132921f2f None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:39:59.961497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b7773-6318-4547-ba45-94e132921f2f None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:39:59.961769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b7773-6318-4547-ba45-94e132921f2f None admin] PATH_INFO: `/v3/services` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:39:59.962387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b7773-6318-4547-ba45-94e132921f2f None admin] RBAC: Adding query filter params (type=placement) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:39:59.962690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b7773-6318-4547-ba45-94e132921f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:39:59.964085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b7773-6318-4547-ba45-94e132921f2f None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:39:59.969068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 643/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 24 07:39:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:40:01.878560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d9bf-e0a9-491e-a899-ad3005a241c7 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:01.879126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d9bf-e0a9-491e-a899-ad3005a241c7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:01.879126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d9bf-e0a9-491e-a899-ad3005a241c7 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:01.880481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 650/1293] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:40:01.885807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf5f2f-29c4-4a77-be3c-dd5eccb3f968 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:01.887467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf5f2f-29c4-4a77-be3c-dd5eccb3f968 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:01.887467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf5f2f-29c4-4a77-be3c-dd5eccb3f968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:01.904892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-39cf5f2f-29c4-4a77-be3c-dd5eccb3f968 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:40:01.906698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-39cf5f2f-29c4-4a77-be3c-dd5eccb3f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:40:01.935993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:01.973909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 644/1294] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:40:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:40:02.248139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47d9bf-e0a9-491e-a899-ad3005a241c7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:40:02.280640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:02.353018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47d9bf-e0a9-491e-a899-ad3005a241c7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:40:02.388039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d0ef7-dbb2-4b37-9bd6-9acb5651ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:40:02.388645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d0ef7-dbb2-4b37-9bd6-9acb5651ad24 None admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:02.388927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d0ef7-dbb2-4b37-9bd6-9acb5651ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:02.389199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d0ef7-dbb2-4b37-9bd6-9acb5651ad24 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:02.389834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d0ef7-dbb2-4b37-9bd6-9acb5651ad24 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:40:02.391850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d0ef7-dbb2-4b37-9bd6-9acb5651ad24 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:40:02.475770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 651/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 24 07:40:02 2022] POST /identity/v3/services => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:40:04.410819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814370af-b9a8-4fe7-a8cc-1ec5bd0df5e7 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:04.411409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814370af-b9a8-4fe7-a8cc-1ec5bd0df5e7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:04.411512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814370af-b9a8-4fe7-a8cc-1ec5bd0df5e7 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:04.412934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 645/1296] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:40:04.418607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac1859-bbe9-4770-8bff-0a0b4d98add3 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:04.419034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac1859-bbe9-4770-8bff-0a0b4d98add3 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:04.419156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac1859-bbe9-4770-8bff-0a0b4d98add3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:04.438461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a7ac1859-bbe9-4770-8bff-0a0b4d98add3 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:40:04.439729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a7ac1859-bbe9-4770-8bff-0a0b4d98add3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:40:04.512105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 652/1297] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:40:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:40:04.792881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814370af-b9a8-4fe7-a8cc-1ec5bd0df5e7 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:40:04.896720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814370af-b9a8-4fe7-a8cc-1ec5bd0df5e7 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:40:04.930746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71189d-3a64-4e3e-a912-ac151061efa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:40:04.931680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71189d-3a64-4e3e-a912-ac151061efa0 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:04.931975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71189d-3a64-4e3e-a912-ac151061efa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:04.932249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71189d-3a64-4e3e-a912-ac151061efa0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:04.932829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71189d-3a64-4e3e-a912-ac151061efa0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:40:04.934184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71189d-3a64-4e3e-a912-ac151061efa0 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-2f71189d-3a64-4e3e-a912-ac151061efa0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:40:04.943183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:40:04.944384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:40:04.945269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 646/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:40:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:40:04.950825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac1859-bbe9-4770-8bff-0a0b4d98add3 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:40:04.970090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:05.049921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac1859-bbe9-4770-8bff-0a0b4d98add3 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:40:05.085491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a14a9-7fe8-44cf-a9f7-891fa4701e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:40:05.086095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a14a9-7fe8-44cf-a9f7-891fa4701e88 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:05.086377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a14a9-7fe8-44cf-a9f7-891fa4701e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:05.086805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a14a9-7fe8-44cf-a9f7-891fa4701e88 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:05.087888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a14a9-7fe8-44cf-a9f7-891fa4701e88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:40:05.088430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a14a9-7fe8-44cf-a9f7-891fa4701e88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:40:05.090826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a14a9-7fe8-44cf-a9f7-891fa4701e88 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:40:05.096898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 653/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 24 07:40:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:40:05.102975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71189d-3a64-4e3e-a912-ac151061efa0 None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:40:05.139626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:05.209517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71189d-3a64-4e3e-a912-ac151061efa0 None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:40:05.243112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78923d2d-a5e3-4fb7-879d-659daeed85d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:40:05.243740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923d2d-a5e3-4fb7-879d-659daeed85d7 None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:05.244025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923d2d-a5e3-4fb7-879d-659daeed85d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:05.244300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923d2d-a5e3-4fb7-879d-659daeed85d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:05.244983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78923d2d-a5e3-4fb7-879d-659daeed85d7 None admin] RBAC: Adding query filter params (interface=public, service_id=33f9086e89764892ba60978cc3c17047, region_id=RegionOne) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:40:05.245286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78923d2d-a5e3-4fb7-879d-659daeed85d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:40:05.246630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78923d2d-a5e3-4fb7-879d-659daeed85d7 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:40:05.252276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 647/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 24 07:40:05 2022] GET /identity/v3/endpoints?service_id=33f9086e89764892ba60978cc3c17047&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:40:05.257971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a14a9-7fe8-44cf-a9f7-891fa4701e88 None admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:40:05.338843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:05.357229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a14a9-7fe8-44cf-a9f7-891fa4701e88 None admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:40:05.392830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b96dc4-6ad3-4521-b0b5-a2cb2ae0015c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:40:05.393438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b96dc4-6ad3-4521-b0b5-a2cb2ae0015c None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:05.394187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b96dc4-6ad3-4521-b0b5-a2cb2ae0015c None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:05.394476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b96dc4-6ad3-4521-b0b5-a2cb2ae0015c None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:05.395128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b96dc4-6ad3-4521-b0b5-a2cb2ae0015c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:40:05.396560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b96dc4-6ad3-4521-b0b5-a2cb2ae0015c None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:40:05.403350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 654/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 24 07:40:05 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:40:07.298351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1c781-5c70-43dc-9776-056d446d1647 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:07.298895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1c781-5c70-43dc-9776-056d446d1647 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:07.298895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1c781-5c70-43dc-9776-056d446d1647 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:07.300278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 648/1302] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:40:07.305374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913f3a-71ae-48a2-9519-418c1620b7d1 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:07.305744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913f3a-71ae-48a2-9519-418c1620b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:07.305935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9913f3a-71ae-48a2-9519-418c1620b7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:07.323691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-f9913f3a-71ae-48a2-9519-418c1620b7d1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:40:07.324869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f9913f3a-71ae-48a2-9519-418c1620b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:40:07.392348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 655/1303] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:40:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:40:07.665168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1c781-5c70-43dc-9776-056d446d1647 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:40:07.762271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:07.768915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1c781-5c70-43dc-9776-056d446d1647 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:40:07.802304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15c494-76ad-41b4-ab44-d5bec8c27d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:40:07.802947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15c494-76ad-41b4-ab44-d5bec8c27d7d None admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:07.803216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15c494-76ad-41b4-ab44-d5bec8c27d7d None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:07.803519 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15c494-76ad-41b4-ab44-d5bec8c27d7d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:07.804094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15c494-76ad-41b4-ab44-d5bec8c27d7d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:40:07.805446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15c494-76ad-41b4-ab44-d5bec8c27d7d None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application [None req-aa15c494-76ad-41b4-ab44-d5bec8c27d7d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:40:07.814645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:40:07.815885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application with Lock( Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: ERROR keystone.server.flask.application Aug 24 07:40:07.816716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 649/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 24 07:40:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:40:07.822091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9913f3a-71ae-48a2-9519-418c1620b7d1 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:40:07.897829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:07.919667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9913f3a-71ae-48a2-9519-418c1620b7d1 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:40:07.952564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1385a3-5904-4a03-ba5e-f8edbffcd827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:40:07.953165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1385a3-5904-4a03-ba5e-f8edbffcd827 None admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:07.953447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1385a3-5904-4a03-ba5e-f8edbffcd827 None admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:07.953719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1385a3-5904-4a03-ba5e-f8edbffcd827 None admin] PATH_INFO: `/v3/services` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:07.954342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1385a3-5904-4a03-ba5e-f8edbffcd827 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:40:07.954643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1385a3-5904-4a03-ba5e-f8edbffcd827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:40:07.956041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1385a3-5904-4a03-ba5e-f8edbffcd827 None admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:40:07.960954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 656/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 24 07:40:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:40:07.966976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15c494-76ad-41b4-ab44-d5bec8c27d7d None admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:40:08.064849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15c494-76ad-41b4-ab44-d5bec8c27d7d None admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:40:08.097143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15099ea5-1afe-4192-bc2b-fe11a6ec7494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:40:08.097736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15099ea5-1afe-4192-bc2b-fe11a6ec7494 None admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:40:08.098014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15099ea5-1afe-4192-bc2b-fe11a6ec7494 None admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:40:08.098284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15099ea5-1afe-4192-bc2b-fe11a6ec7494 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:40:08.098936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15099ea5-1afe-4192-bc2b-fe11a6ec7494 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:40:08.100321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15099ea5-1afe-4192-bc2b-fe11a6ec7494 None admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:40:08.187307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 650/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:40:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:40:17.969926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=30 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:18.182270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:23.002223 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed640-bb27-44ae-a8c5-7ea2c7abe2f8 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:23.002654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed640-bb27-44ae-a8c5-7ea2c7abe2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:23.002742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed640-bb27-44ae-a8c5-7ea2c7abe2f8 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:23.009761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc13de6-1ae8-4312-a69d-b9c65977b58c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:23.010206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc13de6-1ae8-4312-a69d-b9c65977b58c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:23.010365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc13de6-1ae8-4312-a69d-b9c65977b58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:23.013206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 657/1307] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:23.106865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8bc13de6-1ae8-4312-a69d-b9c65977b58c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:23.108770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8bc13de6-1ae8-4312-a69d-b9c65977b58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:23.367850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 651/1308] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:23.665528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0a6f-3234-477e-b27d-c26682ebe02b None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:23.665876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0a6f-3234-477e-b27d-c26682ebe02b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:23.666085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0a6f-3234-477e-b27d-c26682ebe02b None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:23.667549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 658/1309] 10.222.0.17 () {54 vars in 965 bytes} [Wed Aug 24 07:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:23.673258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033134e-2a2a-4c6f-b8e5-08f7c44497fc None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:23.673621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033134e-2a2a-4c6f-b8e5-08f7c44497fc None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:23.673967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033134e-2a2a-4c6f-b8e5-08f7c44497fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:23.759447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8033134e-2a2a-4c6f-b8e5-08f7c44497fc None None] MFA Rules not processed for user `a4403ef0835a4d658f8eb50fac0780eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:23.760663 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8033134e-2a2a-4c6f-b8e5-08f7c44497fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:23.782731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:23.844417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 652/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Aug 24 07:46:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:23.853971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0a6f-3234-477e-b27d-c26682ebe02b None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:23.855783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-723e0a6f-3234-477e-b27d-c26682ebe02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:23.979087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0a6f-3234-477e-b27d-c26682ebe02b None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:24.060373 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f2edf-9aa4-4ee8-a7f2-39d34494431d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:24.061067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f2edf-9aa4-4ee8-a7f2-39d34494431d service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:24.061351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f2edf-9aa4-4ee8-a7f2-39d34494431d service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:24.061541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f2edf-9aa4-4ee8-a7f2-39d34494431d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:24.063113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7a8f2edf-9aa4-4ee8-a7f2-39d34494431d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:24.120493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:24.178740 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f2edf-9aa4-4ee8-a7f2-39d34494431d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:24.180806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f2edf-9aa4-4ee8-a7f2-39d34494431d service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:24.201533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 659/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:46:26.420899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0306c3f-bc3b-4e5a-8c9f-41da7d2df945 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:26.421393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0306c3f-bc3b-4e5a-8c9f-41da7d2df945 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:26.421522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0306c3f-bc3b-4e5a-8c9f-41da7d2df945 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:26.422796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 653/1312] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:26.428528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ce41-f6d3-490b-8eaf-43a22ec5a9e4 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:26.428943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ce41-f6d3-490b-8eaf-43a22ec5a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:26.429081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ce41-f6d3-490b-8eaf-43a22ec5a9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:26.501541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e147ce41-f6d3-490b-8eaf-43a22ec5a9e4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:26.502790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e147ce41-f6d3-490b-8eaf-43a22ec5a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:26.601568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 660/1313] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:26.905130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade15c76-f5ca-4928-9291-86128288d5cc None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:26.905415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade15c76-f5ca-4928-9291-86128288d5cc None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:26.905696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade15c76-f5ca-4928-9291-86128288d5cc None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:26.907032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 654/1314] 10.222.0.17 () {54 vars in 965 bytes} [Wed Aug 24 07:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:26.913104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8ddb7-9e3b-459a-8fac-0e627205fe3a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:26.913389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8ddb7-9e3b-459a-8fac-0e627205fe3a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:26.913666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8ddb7-9e3b-459a-8fac-0e627205fe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:26.925308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:26.991001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-07f8ddb7-9e3b-459a-8fac-0e627205fe3a None None] MFA Rules not processed for user `a4403ef0835a4d658f8eb50fac0780eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:26.992253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-07f8ddb7-9e3b-459a-8fac-0e627205fe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:27.067847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 661/1315] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Aug 24 07:46:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:27.076814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade15c76-f5ca-4928-9291-86128288d5cc None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:27.078330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ade15c76-f5ca-4928-9291-86128288d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:27.182614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade15c76-f5ca-4928-9291-86128288d5cc None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:27.253948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:27.256567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7428b-abfb-4763-a9a2-18b10a872a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:27.257178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7428b-abfb-4763-a9a2-18b10a872a11 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:27.257460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7428b-abfb-4763-a9a2-18b10a872a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:27.257763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7428b-abfb-4763-a9a2-18b10a872a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:27.259407 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-18b7428b-abfb-4763-a9a2-18b10a872a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:27.369299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7428b-abfb-4763-a9a2-18b10a872a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:27.370726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7428b-abfb-4763-a9a2-18b10a872a11 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:27.389035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 655/1316] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:46:30.146143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3732a-cdef-4621-9996-125346a0583d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:30.146732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3732a-cdef-4621-9996-125346a0583d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:30.146732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3732a-cdef-4621-9996-125346a0583d None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:30.148072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 662/1317] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:30.153347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9143ea-214a-4662-af08-035bfb88361e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:30.153761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9143ea-214a-4662-af08-035bfb88361e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:30.153860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9143ea-214a-4662-af08-035bfb88361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:30.219429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ac9143ea-214a-4662-af08-035bfb88361e None None] MFA Rules not processed for user `68a49a46fc8d49ef97ff34e2e36f8ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:30.220649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ac9143ea-214a-4662-af08-035bfb88361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:30.272481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:30.317213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 656/1318] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:30.605794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3732a-cdef-4621-9996-125346a0583d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:30.607376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-64d3732a-cdef-4621-9996-125346a0583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:30.711621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3732a-cdef-4621-9996-125346a0583d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:30.714442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:30.785821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1fa0d-3d32-495f-a911-d3de0aa75390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:30.786423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1fa0d-3d32-495f-a911-d3de0aa75390 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:30.786705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1fa0d-3d32-495f-a911-d3de0aa75390 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:30.786988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1fa0d-3d32-495f-a911-d3de0aa75390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:30.788620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-85f1fa0d-3d32-495f-a911-d3de0aa75390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:30.897113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1fa0d-3d32-495f-a911-d3de0aa75390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:30.898437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1fa0d-3d32-495f-a911-d3de0aa75390 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:30.916875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 663/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:46:33.593856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd83f09-4b61-446c-93e6-eff67a8179c2 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:33.594419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd83f09-4b61-446c-93e6-eff67a8179c2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:33.594419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd83f09-4b61-446c-93e6-eff67a8179c2 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:33.595774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 657/1320] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:33.601575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edd130-9b46-4714-94ab-25523da51ee4 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:33.602028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edd130-9b46-4714-94ab-25523da51ee4 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:33.602127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edd130-9b46-4714-94ab-25523da51ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:33.642257 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:33.668889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-00edd130-9b46-4714-94ab-25523da51ee4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:33.670094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-00edd130-9b46-4714-94ab-25523da51ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:33.772080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 664/1321] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:34.057502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd83f09-4b61-446c-93e6-eff67a8179c2 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:34.059040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0bd83f09-4b61-446c-93e6-eff67a8179c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:34.160644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd83f09-4b61-446c-93e6-eff67a8179c2 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:34.234551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1b0ae-47df-4e63-9fe7-fb9a980eb715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:34.235150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1b0ae-47df-4e63-9fe7-fb9a980eb715 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:34.235461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1b0ae-47df-4e63-9fe7-fb9a980eb715 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:34.235731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1b0ae-47df-4e63-9fe7-fb9a980eb715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:34.237312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ddd1b0ae-47df-4e63-9fe7-fb9a980eb715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:34.244478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:34.345706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1b0ae-47df-4e63-9fe7-fb9a980eb715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:34.347111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1b0ae-47df-4e63-9fe7-fb9a980eb715 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:34.366256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 658/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:46:37.189894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf08d4-fdf8-42f9-afd3-e5ec72438cc9 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:37.190689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf08d4-fdf8-42f9-afd3-e5ec72438cc9 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:37.190689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf08d4-fdf8-42f9-afd3-e5ec72438cc9 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:37.192196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 665/1323] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:37.197388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9dd3-bf7e-43ea-b0ca-f98ffa8f59e7 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:37.197832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9dd3-bf7e-43ea-b0ca-f98ffa8f59e7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:37.197928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9dd3-bf7e-43ea-b0ca-f98ffa8f59e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:37.263480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-25ca9dd3-bf7e-43ea-b0ca-f98ffa8f59e7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:37.264731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-25ca9dd3-bf7e-43ea-b0ca-f98ffa8f59e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:37.324043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:37.367395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 659/1324] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:37.649539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf08d4-fdf8-42f9-afd3-e5ec72438cc9 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:37.651188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7eaf08d4-fdf8-42f9-afd3-e5ec72438cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:37.764882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf08d4-fdf8-42f9-afd3-e5ec72438cc9 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:37.778362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:37.842294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf96eb9-f4fb-470a-942a-b9648cbbf2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:37.842899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf96eb9-f4fb-470a-942a-b9648cbbf2da service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:37.843174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf96eb9-f4fb-470a-942a-b9648cbbf2da service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:37.843472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf96eb9-f4fb-470a-942a-b9648cbbf2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:37.845086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-fdf96eb9-f4fb-470a-942a-b9648cbbf2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:37.956065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf96eb9-f4fb-470a-942a-b9648cbbf2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:37.958113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf96eb9-f4fb-470a-942a-b9648cbbf2da service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:37.976527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 666/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:46:39.946947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd2d81-cee8-41c8-a0d0-2a80482c84cb None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:39.947469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd2d81-cee8-41c8-a0d0-2a80482c84cb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:39.947594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd2d81-cee8-41c8-a0d0-2a80482c84cb None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:39.948849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 660/1326] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:46:39.954095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38405d65-e56b-4e85-b4e0-52ec9714707f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:39.954493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38405d65-e56b-4e85-b4e0-52ec9714707f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:39.954652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38405d65-e56b-4e85-b4e0-52ec9714707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:40.008081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:40.027389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-38405d65-e56b-4e85-b4e0-52ec9714707f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:40.028603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-38405d65-e56b-4e85-b4e0-52ec9714707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:40.125235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 667/1327] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:40.407968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd2d81-cee8-41c8-a0d0-2a80482c84cb None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:40.409540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-33cd2d81-cee8-41c8-a0d0-2a80482c84cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:40.518682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd2d81-cee8-41c8-a0d0-2a80482c84cb None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:40.594839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03407c-a3ea-4a2c-a103-54e9561259c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:40.595481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03407c-a3ea-4a2c-a103-54e9561259c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:40.595760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03407c-a3ea-4a2c-a103-54e9561259c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:40.596028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03407c-a3ea-4a2c-a103-54e9561259c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:40.598484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4a03407c-a3ea-4a2c-a103-54e9561259c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:40.615563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:40.723751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03407c-a3ea-4a2c-a103-54e9561259c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:40.725197 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03407c-a3ea-4a2c-a103-54e9561259c1 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:40.744184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 661/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:46:42.727625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75ffe3-fc9b-4f30-86bc-d99496246d3b None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:42.728179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75ffe3-fc9b-4f30-86bc-d99496246d3b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:42.728179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75ffe3-fc9b-4f30-86bc-d99496246d3b None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:42.729534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 668/1329] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:42.734904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e25a7-af71-4863-a040-4a663495717f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:42.735347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e25a7-af71-4863-a040-4a663495717f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:42.735600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e25a7-af71-4863-a040-4a663495717f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:42.802210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-152e25a7-af71-4863-a040-4a663495717f None None] MFA Rules not processed for user `68a49a46fc8d49ef97ff34e2e36f8ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:42.803517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-152e25a7-af71-4863-a040-4a663495717f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:42.870770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:42.903812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 662/1330] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:46:43.190573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75ffe3-fc9b-4f30-86bc-d99496246d3b None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:43.192893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7e75ffe3-fc9b-4f30-86bc-d99496246d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:43.298164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75ffe3-fc9b-4f30-86bc-d99496246d3b None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:43.319070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:43.391477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac35c0a-df9d-4a59-8709-40f5af7b13fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:43.392085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35c0a-df9d-4a59-8709-40f5af7b13fe service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:43.392375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35c0a-df9d-4a59-8709-40f5af7b13fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:43.392653 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35c0a-df9d-4a59-8709-40f5af7b13fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:43.395640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0ac35c0a-df9d-4a59-8709-40f5af7b13fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:43.510644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac35c0a-df9d-4a59-8709-40f5af7b13fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:43.512125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac35c0a-df9d-4a59-8709-40f5af7b13fe service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:43.530198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 669/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:46:45.936304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a881-b09c-445b-bede-f09746aa5d88 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:45.936830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a881-b09c-445b-bede-f09746aa5d88 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:45.936830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1a881-b09c-445b-bede-f09746aa5d88 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:45.938173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 663/1332] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:45.944041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1764c80-4ffd-4a88-b5c6-67bc6341a5d5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:45.944495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1764c80-4ffd-4a88-b5c6-67bc6341a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:45.944620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1764c80-4ffd-4a88-b5c6-67bc6341a5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:46.007937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:46.010619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-f1764c80-4ffd-4a88-b5c6-67bc6341a5d5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:46.011856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f1764c80-4ffd-4a88-b5c6-67bc6341a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:46.107547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 670/1333] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:46.391231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a881-b09c-445b-bede-f09746aa5d88 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:46.392784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b7d1a881-b09c-445b-bede-f09746aa5d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:46.499543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1a881-b09c-445b-bede-f09746aa5d88 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:46.571556 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1aee8f-9a88-42df-88d6-821bcb59a988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:46.572145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aee8f-9a88-42df-88d6-821bcb59a988 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:46.572430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aee8f-9a88-42df-88d6-821bcb59a988 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:46.572707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aee8f-9a88-42df-88d6-821bcb59a988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:46.574282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6c1aee8f-9a88-42df-88d6-821bcb59a988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:46.601292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:46.683674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1aee8f-9a88-42df-88d6-821bcb59a988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:46.685162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1aee8f-9a88-42df-88d6-821bcb59a988 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:46.706558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 664/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:46:48.653400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b4acd-0824-4045-878b-c6027b22c61b None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:48.653839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b4acd-0824-4045-878b-c6027b22c61b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:48.653960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b4acd-0824-4045-878b-c6027b22c61b None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:48.655334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 671/1335] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:48.661078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975de822-e96e-4db1-b7e2-eee6698caec1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:48.661460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975de822-e96e-4db1-b7e2-eee6698caec1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:48.661640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975de822-e96e-4db1-b7e2-eee6698caec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:48.727060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-975de822-e96e-4db1-b7e2-eee6698caec1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:48.728299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-975de822-e96e-4db1-b7e2-eee6698caec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:48.806741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:48.829353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 665/1336] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:49.120867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b4acd-0824-4045-878b-c6027b22c61b None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:49.122418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8e1b4acd-0824-4045-878b-c6027b22c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:49.230828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b4acd-0824-4045-878b-c6027b22c61b None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:49.259397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:49.304122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684b7fe-2e22-4b8c-94b8-78feb97b7eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:49.304725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684b7fe-2e22-4b8c-94b8-78feb97b7eae service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:49.305020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684b7fe-2e22-4b8c-94b8-78feb97b7eae service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:49.305294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684b7fe-2e22-4b8c-94b8-78feb97b7eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:49.306891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8684b7fe-2e22-4b8c-94b8-78feb97b7eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:49.417666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684b7fe-2e22-4b8c-94b8-78feb97b7eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:49.419051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684b7fe-2e22-4b8c-94b8-78feb97b7eae service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:49.437288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 672/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:46:51.945094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067301-f2da-43a5-aac6-aed6712c416e None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:51.945631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067301-f2da-43a5-aac6-aed6712c416e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:51.945631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067301-f2da-43a5-aac6-aed6712c416e None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:51.946956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 666/1338] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:51.952161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf244-93f2-48de-8fbb-d8103694a2e8 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:51.952569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf244-93f2-48de-8fbb-d8103694a2e8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:51.952703 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16baf244-93f2-48de-8fbb-d8103694a2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:52.017109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-16baf244-93f2-48de-8fbb-d8103694a2e8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:52.018290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-16baf244-93f2-48de-8fbb-d8103694a2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:52.026466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:52.121178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 673/1339] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:52.399376 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067301-f2da-43a5-aac6-aed6712c416e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:52.400907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-78067301-f2da-43a5-aac6-aed6712c416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:52.503480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067301-f2da-43a5-aac6-aed6712c416e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:52.575111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd6288-7f26-4a7f-a736-b87abbb07a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:52.575738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6288-7f26-4a7f-a736-b87abbb07a42 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:52.576021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6288-7f26-4a7f-a736-b87abbb07a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:52.576294 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6288-7f26-4a7f-a736-b87abbb07a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:52.577876 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ffbd6288-7f26-4a7f-a736-b87abbb07a42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:52.612389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:52.683809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd6288-7f26-4a7f-a736-b87abbb07a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:52.685248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd6288-7f26-4a7f-a736-b87abbb07a42 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:52.704828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 667/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:46:57.132227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d6f21-8615-4879-9cc8-80e8cb7df5a3 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:57.132741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d6f21-8615-4879-9cc8-80e8cb7df5a3 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:57.132741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d6f21-8615-4879-9cc8-80e8cb7df5a3 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:57.134200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 674/1341] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:57.139351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d525-7b1b-404f-8f76-ef7577352422 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:57.139792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d525-7b1b-404f-8f76-ef7577352422 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:57.140048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d525-7b1b-404f-8f76-ef7577352422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:57.209799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8780d525-7b1b-404f-8f76-ef7577352422 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:57.211017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8780d525-7b1b-404f-8f76-ef7577352422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:57.300544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:57.311725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 668/1342] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:46:57.595191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d6f21-8615-4879-9cc8-80e8cb7df5a3 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:57.596765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-149d6f21-8615-4879-9cc8-80e8cb7df5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:57.703619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d6f21-8615-4879-9cc8-80e8cb7df5a3 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:57.741707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:57.778824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23111eb-377f-4b51-a9e8-b95e35d23df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:57.780395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23111eb-377f-4b51-a9e8-b95e35d23df7 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:57.780395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23111eb-377f-4b51-a9e8-b95e35d23df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:57.780395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23111eb-377f-4b51-a9e8-b95e35d23df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:57.783055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a23111eb-377f-4b51-a9e8-b95e35d23df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:57.894688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23111eb-377f-4b51-a9e8-b95e35d23df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:57.896086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23111eb-377f-4b51-a9e8-b95e35d23df7 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:57.915057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 675/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:00.857076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bcc48-f4f4-4c28-83e3-61995ce43081 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:00.857625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bcc48-f4f4-4c28-83e3-61995ce43081 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:00.857625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bcc48-f4f4-4c28-83e3-61995ce43081 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:00.858883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 669/1344] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:00.864617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21e08-68da-4a73-9084-b8255036636d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:00.865081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21e08-68da-4a73-9084-b8255036636d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:00.865201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21e08-68da-4a73-9084-b8255036636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:00.931769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-48f21e08-68da-4a73-9084-b8255036636d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:00.932899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-48f21e08-68da-4a73-9084-b8255036636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:00.950973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:01.030534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 676/1345] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:01.324286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bcc48-f4f4-4c28-83e3-61995ce43081 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:01.325802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a04bcc48-f4f4-4c28-83e3-61995ce43081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:01.431066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bcc48-f4f4-4c28-83e3-61995ce43081 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:01.506453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cffc0-8db4-497a-8bc0-99b02c494e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:01.507065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cffc0-8db4-497a-8bc0-99b02c494e24 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:01.507364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cffc0-8db4-497a-8bc0-99b02c494e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:01.507632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cffc0-8db4-497a-8bc0-99b02c494e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:01.509264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6b9cffc0-8db4-497a-8bc0-99b02c494e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:01.553498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:01.624055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cffc0-8db4-497a-8bc0-99b02c494e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:01.625405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cffc0-8db4-497a-8bc0-99b02c494e24 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:01.645727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 670/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:05.787068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9d32-f266-4bdf-897f-81252ba67b52 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:05.787644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9d32-f266-4bdf-897f-81252ba67b52 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:05.787644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9d32-f266-4bdf-897f-81252ba67b52 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:05.788977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 677/1347] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:05.794531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17a4d2-cf40-47b2-8015-67a47585d150 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:05.794977 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17a4d2-cf40-47b2-8015-67a47585d150 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:05.795151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17a4d2-cf40-47b2-8015-67a47585d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:05.869210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8e17a4d2-cf40-47b2-8015-67a47585d150 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:05.870431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8e17a4d2-cf40-47b2-8015-67a47585d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:05.972821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:05.975254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 671/1348] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:06.261421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9d32-f266-4bdf-897f-81252ba67b52 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:06.262973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-682f9d32-f266-4bdf-897f-81252ba67b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:06.369682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9d32-f266-4bdf-897f-81252ba67b52 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:06.417413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:06.445024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950e85f-4d0b-4d5d-8023-193184f2a9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:06.445629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950e85f-4d0b-4d5d-8023-193184f2a9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:06.445915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950e85f-4d0b-4d5d-8023-193184f2a9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:06.446190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950e85f-4d0b-4d5d-8023-193184f2a9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:06.447828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9950e85f-4d0b-4d5d-8023-193184f2a9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:06.557577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950e85f-4d0b-4d5d-8023-193184f2a9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:06.558910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950e85f-4d0b-4d5d-8023-193184f2a9a0 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:06.577706 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 678/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:11.563991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a918ca-7dec-4078-816e-1737cf57d22b None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:11.564511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a918ca-7dec-4078-816e-1737cf57d22b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:11.564511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a918ca-7dec-4078-816e-1737cf57d22b None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:11.569163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 672/1350] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:47:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:11.574725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5f5c-df59-41f8-872d-a6cff11df201 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:11.575980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5f5c-df59-41f8-872d-a6cff11df201 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:11.576301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5f5c-df59-41f8-872d-a6cff11df201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:11.686615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-147e5f5c-df59-41f8-872d-a6cff11df201 None None] MFA Rules not processed for user `36bd5aef3c034c41be036c4cc9eed376`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:11.688264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-147e5f5c-df59-41f8-872d-a6cff11df201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:11.710818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:11.825711 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 679/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:47:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:16.072093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898c0b2-66e7-49b4-8a02-6879e10eee97 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:16.072949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898c0b2-66e7-49b4-8a02-6879e10eee97 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:16.073379 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898c0b2-66e7-49b4-8a02-6879e10eee97 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:16.075153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 673/1352] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:16.080285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb75954-6634-472e-b089-cb64cb1c24ed None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:16.080730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb75954-6634-472e-b089-cb64cb1c24ed None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:16.081509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb75954-6634-472e-b089-cb64cb1c24ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:16.163084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-afb75954-6634-472e-b089-cb64cb1c24ed None None] MFA Rules not processed for user `36bd5aef3c034c41be036c4cc9eed376`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:16.164431 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-afb75954-6634-472e-b089-cb64cb1c24ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:16.241219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:16.280479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 680/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:47:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:17.737824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97804b1-c13e-45f1-aacc-bec14ad29563 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:17.738770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97804b1-c13e-45f1-aacc-bec14ad29563 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:17.738770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97804b1-c13e-45f1-aacc-bec14ad29563 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:17.739674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 674/1354] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:17.744834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1f04d-74ae-4fec-abb9-6e67e6c96b43 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:17.745248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1f04d-74ae-4fec-abb9-6e67e6c96b43 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:17.745539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1f04d-74ae-4fec-abb9-6e67e6c96b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:17.828023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-91c1f04d-74ae-4fec-abb9-6e67e6c96b43 None None] MFA Rules not processed for user `36bd5aef3c034c41be036c4cc9eed376`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:17.829231 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-91c1f04d-74ae-4fec-abb9-6e67e6c96b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:17.944467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 681/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:47:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:47:21.279918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2778d0-89f7-44e5-85f7-ec2de869217d None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:21.280464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2778d0-89f7-44e5-85f7-ec2de869217d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:21.280464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2778d0-89f7-44e5-85f7-ec2de869217d None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:21.281797 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 675/1356] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:21.288049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644da9d-19ce-44e3-9c27-356a8fdff01a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:21.288458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644da9d-19ce-44e3-9c27-356a8fdff01a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:21.288593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644da9d-19ce-44e3-9c27-356a8fdff01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:21.325465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:21.378950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-5644da9d-19ce-44e3-9c27-356a8fdff01a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:21.380314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5644da9d-19ce-44e3-9c27-356a8fdff01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:21.512033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 682/1357] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:21.817095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495d37e-e3af-4da0-9ae5-775fbe9021d5 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:21.817939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495d37e-e3af-4da0-9ae5-775fbe9021d5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:21.818501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495d37e-e3af-4da0-9ae5-775fbe9021d5 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:21.820563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 676/1358] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 24 07:47:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:21.829115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9155e-a78f-4214-981f-38392ad9a2fc None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:21.829403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9155e-a78f-4214-981f-38392ad9a2fc None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:21.829677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9155e-a78f-4214-981f-38392ad9a2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:21.920404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-15e9155e-a78f-4214-981f-38392ad9a2fc None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:21.921707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-15e9155e-a78f-4214-981f-38392ad9a2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:21.981517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:22.076733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 683/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 24 07:47:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:22.077726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495d37e-e3af-4da0-9ae5-775fbe9021d5 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:22.080608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1495d37e-e3af-4da0-9ae5-775fbe9021d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:22.238517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495d37e-e3af-4da0-9ae5-775fbe9021d5 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:22.319632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:22.366716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fceef-ed5c-4258-9aef-cbb66c764a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:22.367700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fceef-ed5c-4258-9aef-cbb66c764a31 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:22.368259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fceef-ed5c-4258-9aef-cbb66c764a31 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:22.368733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fceef-ed5c-4258-9aef-cbb66c764a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:22.370497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-526fceef-ed5c-4258-9aef-cbb66c764a31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:22.472070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fceef-ed5c-4258-9aef-cbb66c764a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:22.473662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fceef-ed5c-4258-9aef-cbb66c764a31 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:22.494448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 677/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:24.739439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7085c-56ce-467f-a628-025945f5f95f None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:24.739962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7085c-56ce-467f-a628-025945f5f95f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:24.740066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7085c-56ce-467f-a628-025945f5f95f None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:24.741502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 684/1361] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:24.746776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79097dc2-a402-463a-b388-9688cece9c63 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:24.747194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79097dc2-a402-463a-b388-9688cece9c63 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:24.747365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79097dc2-a402-463a-b388-9688cece9c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:24.819656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-79097dc2-a402-463a-b388-9688cece9c63 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:24.821019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-79097dc2-a402-463a-b388-9688cece9c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:24.861866 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:24.927460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 678/1362] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:25.255552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7085c-56ce-467f-a628-025945f5f95f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:25.258063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cba7085c-56ce-467f-a628-025945f5f95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:25.432572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7085c-56ce-467f-a628-025945f5f95f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:25.443863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:25.555490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226bcbd-fd99-4050-ae9b-53cc43279c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:25.557231 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226bcbd-fd99-4050-ae9b-53cc43279c52 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:25.557231 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226bcbd-fd99-4050-ae9b-53cc43279c52 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:25.557231 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226bcbd-fd99-4050-ae9b-53cc43279c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:25.558311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c226bcbd-fd99-4050-ae9b-53cc43279c52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:25.668159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226bcbd-fd99-4050-ae9b-53cc43279c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:25.669772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226bcbd-fd99-4050-ae9b-53cc43279c52 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:25.689497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 685/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:28.087218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ee466-27f9-4f84-89fe-70849c65b7e4 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:28.088352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ee466-27f9-4f84-89fe-70849c65b7e4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:28.088833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ee466-27f9-4f84-89fe-70849c65b7e4 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:28.094642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 679/1364] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:28.097488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac234f-5209-4b7c-a163-242c845f030f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:28.097948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac234f-5209-4b7c-a163-242c845f030f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:28.098049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac234f-5209-4b7c-a163-242c845f030f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:28.115217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:28.177158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8fac234f-5209-4b7c-a163-242c845f030f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:28.178405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8fac234f-5209-4b7c-a163-242c845f030f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:28.290691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 686/1365] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:28.593057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd36f93-076a-4223-94c8-b279ba376142 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:28.593256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd36f93-076a-4223-94c8-b279ba376142 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:28.594017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd36f93-076a-4223-94c8-b279ba376142 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:28.595647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 680/1366] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 24 07:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:28.603005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5c69-2bdc-4b07-9b46-45c8bb3dc920 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:28.603383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5c69-2bdc-4b07-9b46-45c8bb3dc920 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:28.603676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef5c69-2bdc-4b07-9b46-45c8bb3dc920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:28.695616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-80ef5c69-2bdc-4b07-9b46-45c8bb3dc920 None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:28.696911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-80ef5c69-2bdc-4b07-9b46-45c8bb3dc920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:28.736616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:28.835792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 687/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 24 07:47:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:28.844223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd36f93-076a-4223-94c8-b279ba376142 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:28.845979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cfd36f93-076a-4223-94c8-b279ba376142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:29.008665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd36f93-076a-4223-94c8-b279ba376142 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:29.029555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:29.137603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ab71b-1e40-4353-9ae1-2b05a97d1a05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:29.138312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ab71b-1e40-4353-9ae1-2b05a97d1a05 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:29.138564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ab71b-1e40-4353-9ae1-2b05a97d1a05 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:29.138814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ab71b-1e40-4353-9ae1-2b05a97d1a05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:29.140451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-715ab71b-1e40-4353-9ae1-2b05a97d1a05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:29.239119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ab71b-1e40-4353-9ae1-2b05a97d1a05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:29.240751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ab71b-1e40-4353-9ae1-2b05a97d1a05 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:29.259964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 681/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:29.682563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71737a-0949-4992-8120-467362db828f None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:29.683094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71737a-0949-4992-8120-467362db828f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:29.683094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71737a-0949-4992-8120-467362db828f None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:29.684624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 688/1369] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:29.689999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ee54-d843-49d1-8e42-d1ce9a4ef974 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:29.690349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ee54-d843-49d1-8e42-d1ce9a4ef974 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:29.690681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ee54-d843-49d1-8e42-d1ce9a4ef974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:29.726683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:29.764205 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b536ee54-d843-49d1-8e42-d1ce9a4ef974 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:29.765496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b536ee54-d843-49d1-8e42-d1ce9a4ef974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:29.872940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 682/1370] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:30.490806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ccc3-edb8-4da7-9bbc-12f3891ab325 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:30.491091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ccc3-edb8-4da7-9bbc-12f3891ab325 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:30.491403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ccc3-edb8-4da7-9bbc-12f3891ab325 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:30.492862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 689/1371] 10.222.0.17 () {54 vars in 964 bytes} [Wed Aug 24 07:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:30.497726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b871af-f8cd-4380-a8e4-091bfaab59e2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:30.498313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b871af-f8cd-4380-a8e4-091bfaab59e2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:30.498313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b871af-f8cd-4380-a8e4-091bfaab59e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:30.578891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-14b871af-f8cd-4380-a8e4-091bfaab59e2 None None] MFA Rules not processed for user `a3de64d734a04f9e9ab0d85e5c985e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:30.580466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-14b871af-f8cd-4380-a8e4-091bfaab59e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:30.636648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:30.669921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 683/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Aug 24 07:47:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:30.677704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ccc3-edb8-4da7-9bbc-12f3891ab325 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:30.679232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f543ccc3-edb8-4da7-9bbc-12f3891ab325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:30.790559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ccc3-edb8-4da7-9bbc-12f3891ab325 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:30.853399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:30.888639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403197f-3bdb-4faa-924d-2ba85aa296da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:30.889175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403197f-3bdb-4faa-924d-2ba85aa296da service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:30.889448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403197f-3bdb-4faa-924d-2ba85aa296da service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:30.889716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403197f-3bdb-4faa-924d-2ba85aa296da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:30.891407 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c403197f-3bdb-4faa-924d-2ba85aa296da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:31.010330 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403197f-3bdb-4faa-924d-2ba85aa296da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:31.011682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403197f-3bdb-4faa-924d-2ba85aa296da service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:31.031568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 690/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:47:31.446600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463e0c-294c-4c94-9d71-f234adfc4226 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:31.446815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463e0c-294c-4c94-9d71-f234adfc4226 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:31.447059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463e0c-294c-4c94-9d71-f234adfc4226 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:31.448430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 684/1374] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:31.453803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34bdd3-a064-4c50-8a94-c9016e7da75b None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:31.454099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34bdd3-a064-4c50-8a94-c9016e7da75b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:31.454381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34bdd3-a064-4c50-8a94-c9016e7da75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:31.522531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ae34bdd3-a064-4c50-8a94-c9016e7da75b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:31.523748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ae34bdd3-a064-4c50-8a94-c9016e7da75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:31.545125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:31.620117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 691/1375] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:31.912705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463e0c-294c-4c94-9d71-f234adfc4226 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:31.914297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bf463e0c-294c-4c94-9d71-f234adfc4226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:32.066006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463e0c-294c-4c94-9d71-f234adfc4226 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:32.119021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:32.182198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9519f5-5f23-4e8a-af28-3f72228665c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:32.182796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9519f5-5f23-4e8a-af28-3f72228665c5 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:32.183078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9519f5-5f23-4e8a-af28-3f72228665c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:32.183378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9519f5-5f23-4e8a-af28-3f72228665c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:32.185020 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-aa9519f5-5f23-4e8a-af28-3f72228665c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:32.275035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9519f5-5f23-4e8a-af28-3f72228665c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:32.276652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9519f5-5f23-4e8a-af28-3f72228665c5 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:32.294786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 685/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:34.380605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411ddf-6404-4fd3-9b90-c28e5ac732d7 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:34.381085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411ddf-6404-4fd3-9b90-c28e5ac732d7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:34.381187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d411ddf-6404-4fd3-9b90-c28e5ac732d7 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:34.382481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 692/1377] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:34.387672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748779-b56b-4e9b-97dc-53db8fe1b045 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:34.388095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748779-b56b-4e9b-97dc-53db8fe1b045 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:34.388219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748779-b56b-4e9b-97dc-53db8fe1b045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:34.453021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e3748779-b56b-4e9b-97dc-53db8fe1b045 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:34.454492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e3748779-b56b-4e9b-97dc-53db8fe1b045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:34.461644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:34.559652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 686/1378] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:34.870065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411ddf-6404-4fd3-9b90-c28e5ac732d7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:34.872073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2d411ddf-6404-4fd3-9b90-c28e5ac732d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:35.036361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d411ddf-6404-4fd3-9b90-c28e5ac732d7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:35.040339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:35.160011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9c83a-575f-4df2-8ae8-cbded375647b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:35.160630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9c83a-575f-4df2-8ae8-cbded375647b service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:35.160912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9c83a-575f-4df2-8ae8-cbded375647b service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:35.161185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9c83a-575f-4df2-8ae8-cbded375647b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:35.162823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4ec9c83a-575f-4df2-8ae8-cbded375647b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:35.265502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9c83a-575f-4df2-8ae8-cbded375647b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:35.267278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9c83a-575f-4df2-8ae8-cbded375647b service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:35.289210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 693/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:37.406592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002baf3-0b63-4d71-a2c0-64f2256bc872 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:37.407142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002baf3-0b63-4d71-a2c0-64f2256bc872 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:37.407142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002baf3-0b63-4d71-a2c0-64f2256bc872 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:37.410042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 687/1380] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:37.416851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70148646-663b-401d-b029-798d91d0aed9 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:37.416851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70148646-663b-401d-b029-798d91d0aed9 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:37.416851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70148646-663b-401d-b029-798d91d0aed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:37.426716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:37.485135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-70148646-663b-401d-b029-798d91d0aed9 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:37.486346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-70148646-663b-401d-b029-798d91d0aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:37.599018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 694/1381] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:37.898716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002baf3-0b63-4d71-a2c0-64f2256bc872 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:37.900716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c002baf3-0b63-4d71-a2c0-64f2256bc872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:38.050907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:38.062320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002baf3-0b63-4d71-a2c0-64f2256bc872 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:38.189689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93667c0-0259-4437-a13c-29c258256963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:38.191039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93667c0-0259-4437-a13c-29c258256963 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:38.191855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93667c0-0259-4437-a13c-29c258256963 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:38.194997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93667c0-0259-4437-a13c-29c258256963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:38.194997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b93667c0-0259-4437-a13c-29c258256963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:38.289267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93667c0-0259-4437-a13c-29c258256963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:38.291081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93667c0-0259-4437-a13c-29c258256963 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:38.303025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:38.311467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 688/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:40.650549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412f0f6-769c-44a4-adad-5d2e23269830 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:40.651053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412f0f6-769c-44a4-adad-5d2e23269830 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:40.651427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412f0f6-769c-44a4-adad-5d2e23269830 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:40.653719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 695/1383] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:40.659972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed60749-c01f-461b-b5bc-e7251e037014 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:40.660582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed60749-c01f-461b-b5bc-e7251e037014 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:40.660582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed60749-c01f-461b-b5bc-e7251e037014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:40.738890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-4ed60749-c01f-461b-b5bc-e7251e037014 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:40.741093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4ed60749-c01f-461b-b5bc-e7251e037014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:40.863798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 689/1384] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:41.160937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412f0f6-769c-44a4-adad-5d2e23269830 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:41.162941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7412f0f6-769c-44a4-adad-5d2e23269830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:41.272117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:41.338445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412f0f6-769c-44a4-adad-5d2e23269830 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:41.464506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da38ad-daf4-43f2-82f0-a303e57ff923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:41.465039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da38ad-daf4-43f2-82f0-a303e57ff923 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:41.465358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da38ad-daf4-43f2-82f0-a303e57ff923 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:41.465589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da38ad-daf4-43f2-82f0-a303e57ff923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:41.467201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b9da38ad-daf4-43f2-82f0-a303e57ff923 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:41.531723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:41.584846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da38ad-daf4-43f2-82f0-a303e57ff923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:41.587233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da38ad-daf4-43f2-82f0-a303e57ff923 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:41.614959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 696/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:43.532012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b65d19-a9e0-48d4-8cdb-b95cfdb47cd8 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:43.532545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b65d19-a9e0-48d4-8cdb-b95cfdb47cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:43.532545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b65d19-a9e0-48d4-8cdb-b95cfdb47cd8 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:43.534633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 690/1386] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:43.541406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec9047-61b9-4e8f-bf69-f268c2cda5cc None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:43.541811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec9047-61b9-4e8f-bf69-f268c2cda5cc None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:43.541945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec9047-61b9-4e8f-bf69-f268c2cda5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:43.610666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3fec9047-61b9-4e8f-bf69-f268c2cda5cc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:43.612102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3fec9047-61b9-4e8f-bf69-f268c2cda5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:43.719839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 697/1387] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:44.121886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b65d19-a9e0-48d4-8cdb-b95cfdb47cd8 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:44.123489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-16b65d19-a9e0-48d4-8cdb-b95cfdb47cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:44.205063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:44.300433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b65d19-a9e0-48d4-8cdb-b95cfdb47cd8 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:44.481598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8376c3-0024-4c39-9368-e79e1f95cecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:44.482233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8376c3-0024-4c39-9368-e79e1f95cecc service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:44.482522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8376c3-0024-4c39-9368-e79e1f95cecc service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:44.482804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8376c3-0024-4c39-9368-e79e1f95cecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:44.484521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5a8376c3-0024-4c39-9368-e79e1f95cecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:44.526704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:44.586815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8376c3-0024-4c39-9368-e79e1f95cecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:44.588697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8376c3-0024-4c39-9368-e79e1f95cecc service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:44.608352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 691/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:46.501111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69af4f-9c78-487f-8df9-7ae870b0f84e None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.501690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69af4f-9c78-487f-8df9-7ae870b0f84e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.501690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69af4f-9c78-487f-8df9-7ae870b0f84e None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.503184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 698/1389] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:46.508610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3964590-ee07-4269-b15e-def97fbf20d1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.509027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3964590-ee07-4269-b15e-def97fbf20d1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.509141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3964590-ee07-4269-b15e-def97fbf20d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.576600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c3964590-ee07-4269-b15e-def97fbf20d1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:46.577863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c3964590-ee07-4269-b15e-def97fbf20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:46.668006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d8dd-73d4-4899-bb6f-8a107541ffb7 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.668287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d8dd-73d4-4899-bb6f-8a107541ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.668574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d8dd-73d4-4899-bb6f-8a107541ffb7 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.669903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 699/1390] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:47:46.675325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 692/1391] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:46.675467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692b80d-878f-4908-9fb2-a16495a807b3 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.675623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692b80d-878f-4908-9fb2-a16495a807b3 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.675959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692b80d-878f-4908-9fb2-a16495a807b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.711814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:46.742961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e692b80d-878f-4908-9fb2-a16495a807b3 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:46.744174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e692b80d-878f-4908-9fb2-a16495a807b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:46.840034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 700/1392] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:47:46.975805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5389be9-4212-4bda-8c76-acc7a4491850 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.976163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5389be9-4212-4bda-8c76-acc7a4491850 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.976502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5389be9-4212-4bda-8c76-acc7a4491850 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.977883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 693/1393] 10.222.0.17 () {54 vars in 967 bytes} [Wed Aug 24 07:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:46.983123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bce0b-df03-46bb-8f16-2f06f0033902 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.983455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bce0b-df03-46bb-8f16-2f06f0033902 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.983732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bce0b-df03-46bb-8f16-2f06f0033902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:47.060350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-789bce0b-df03-46bb-8f16-2f06f0033902 None None] MFA Rules not processed for user `f436ac7cc2f04919bb0ec1ad9fca5622`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:47.061564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-789bce0b-df03-46bb-8f16-2f06f0033902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:47.110846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:47.128132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5389be9-4212-4bda-8c76-acc7a4491850 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:47.129687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f5389be9-4212-4bda-8c76-acc7a4491850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:47.140626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 701/1394] 10.222.0.17 () {58 vars in 1064 bytes} [Wed Aug 24 07:47:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:47.144660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:47.149284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bce0b-df03-46bb-8f16-2f06f0033902 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:47.156700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bce0b-df03-46bb-8f16-2f06f0033902 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:47.233810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dead8e-0eda-4cc3-b4f3-34ca32d8b84b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f436ac7cc2f04919bb0ec1ad9fca5622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:47.234676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dead8e-0eda-4cc3-b4f3-34ca32d8b84b service glance] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:47.234955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dead8e-0eda-4cc3-b4f3-34ca32d8b84b service glance] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:47.235221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dead8e-0eda-4cc3-b4f3-34ca32d8b84b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:47.236941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c3dead8e-0eda-4cc3-b4f3-34ca32d8b84b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:47.278897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5389be9-4212-4bda-8c76-acc7a4491850 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:47.345438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dead8e-0eda-4cc3-b4f3-34ca32d8b84b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:47.347702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dead8e-0eda-4cc3-b4f3-34ca32d8b84b service glance] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:47.362373 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:47.367075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 702/1395] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:47:47.375518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:47.407530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc62eb-9383-4452-af4d-1bcd6587c8ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:47.411399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc62eb-9383-4452-af4d-1bcd6587c8ec service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:47.411399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc62eb-9383-4452-af4d-1bcd6587c8ec service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:47.411399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc62eb-9383-4452-af4d-1bcd6587c8ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:47.411399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-adfc62eb-9383-4452-af4d-1bcd6587c8ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:47.508466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc62eb-9383-4452-af4d-1bcd6587c8ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:47.510110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc62eb-9383-4452-af4d-1bcd6587c8ec service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:47.529759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 694/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:47:48.354402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86244-a61f-4832-a7e5-4d8bcce49aa1 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:48.354842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86244-a61f-4832-a7e5-4d8bcce49aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:48.355008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f86244-a61f-4832-a7e5-4d8bcce49aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:48.422729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-09f86244-a61f-4832-a7e5-4d8bcce49aa1 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:48.425022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-09f86244-a61f-4832-a7e5-4d8bcce49aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:48.512540 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 703/1397] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:47:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:48.558721 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d152-4d0e-4a83-9feb-2da3ecd3806c None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:48.559182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d152-4d0e-4a83-9feb-2da3ecd3806c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:48.559420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d152-4d0e-4a83-9feb-2da3ecd3806c None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:48.560861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 695/1398] 10.222.0.17 () {54 vars in 943 bytes} [Wed Aug 24 07:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:48.568437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8204ef-7aa9-4ab2-9226-be3ecf16ee9d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:48.568724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8204ef-7aa9-4ab2-9226-be3ecf16ee9d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:48.568997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8204ef-7aa9-4ab2-9226-be3ecf16ee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:48.645881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-fa8204ef-7aa9-4ab2-9226-be3ecf16ee9d None None] MFA Rules not processed for user `15d9847a3a5048efb19e507f988e37f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:48.646996 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-fa8204ef-7aa9-4ab2-9226-be3ecf16ee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:48.677512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:48.756196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 704/1399] 10.222.0.17 () {58 vars in 1040 bytes} [Wed Aug 24 07:47:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:48.766149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d152-4d0e-4a83-9feb-2da3ecd3806c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:48.768253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-99e7d152-4d0e-4a83-9feb-2da3ecd3806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:48.868566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:48.911229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d152-4d0e-4a83-9feb-2da3ecd3806c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:49.014307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172df57b-986c-4a3f-958a-bde7552bc9c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:49.014904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172df57b-986c-4a3f-958a-bde7552bc9c9 service swift] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:49.015233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172df57b-986c-4a3f-958a-bde7552bc9c9 service swift] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:49.015552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172df57b-986c-4a3f-958a-bde7552bc9c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:49.017169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-172df57b-986c-4a3f-958a-bde7552bc9c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:49.101432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172df57b-986c-4a3f-958a-bde7552bc9c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:49.103016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172df57b-986c-4a3f-958a-bde7552bc9c9 service swift] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:49.106452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:49.111513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 696/1400] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 07:47:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:47:49.620837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678886-21e9-45ae-84c1-d119d0aa63fd None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:49.621351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678886-21e9-45ae-84c1-d119d0aa63fd None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:49.621351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678886-21e9-45ae-84c1-d119d0aa63fd None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:49.622664 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 705/1401] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:49.628566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd849e-660d-4c0a-b0e8-91264d99f8fb None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:49.629005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd849e-660d-4c0a-b0e8-91264d99f8fb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:49.629101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd849e-660d-4c0a-b0e8-91264d99f8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:49.706243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3fcd849e-660d-4c0a-b0e8-91264d99f8fb None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:49.707887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3fcd849e-660d-4c0a-b0e8-91264d99f8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:49.821838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 697/1402] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:50.117672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e678886-21e9-45ae-84c1-d119d0aa63fd None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:50.119317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3e678886-21e9-45ae-84c1-d119d0aa63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:50.297429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e678886-21e9-45ae-84c1-d119d0aa63fd None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:50.301194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:50.429279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee1329-7a0e-45c4-8d59-3b9e9ba8ab3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:50.429886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1329-7a0e-45c4-8d59-3b9e9ba8ab3f service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:50.430170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1329-7a0e-45c4-8d59-3b9e9ba8ab3f service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:50.430447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1329-7a0e-45c4-8d59-3b9e9ba8ab3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:50.432074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e9ee1329-7a0e-45c4-8d59-3b9e9ba8ab3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:50.532089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee1329-7a0e-45c4-8d59-3b9e9ba8ab3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:50.534240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee1329-7a0e-45c4-8d59-3b9e9ba8ab3f service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:50.554316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 706/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:52.733860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e3640-4100-4346-b32b-9d4dbdfe544c None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:52.734459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e3640-4100-4346-b32b-9d4dbdfe544c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:52.734459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e3640-4100-4346-b32b-9d4dbdfe544c None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:52.735932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 698/1404] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:52.741783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124c82-398e-4006-a151-6db16c873497 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:52.742220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124c82-398e-4006-a151-6db16c873497 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:52.742462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124c82-398e-4006-a151-6db16c873497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:52.752858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:52.819638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-bd124c82-398e-4006-a151-6db16c873497 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:52.820874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bd124c82-398e-4006-a151-6db16c873497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:52.928882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 707/1405] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:53.225558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e3640-4100-4346-b32b-9d4dbdfe544c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:53.227161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a80e3640-4100-4346-b32b-9d4dbdfe544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:53.315061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:53.400644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e3640-4100-4346-b32b-9d4dbdfe544c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:53.541562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5ec4f-f4bd-4dd2-be32-5bc1a742364c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:53.542440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ec4f-f4bd-4dd2-be32-5bc1a742364c service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:53.542799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ec4f-f4bd-4dd2-be32-5bc1a742364c service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:53.543143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ec4f-f4bd-4dd2-be32-5bc1a742364c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:53.544853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f5c5ec4f-f4bd-4dd2-be32-5bc1a742364c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:53.590600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:53.648816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5ec4f-f4bd-4dd2-be32-5bc1a742364c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:53.650488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5ec4f-f4bd-4dd2-be32-5bc1a742364c service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:53.672567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 699/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:55.747213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a95a6b-bc5b-444c-bd07-c07df1320d29 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:55.747793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a95a6b-bc5b-444c-bd07-c07df1320d29 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:55.747793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a95a6b-bc5b-444c-bd07-c07df1320d29 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:55.749341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 708/1407] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:55.754804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e96a2-4473-4679-8ec0-81e84dc0f7f4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:55.755656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e96a2-4473-4679-8ec0-81e84dc0f7f4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:55.756124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e96a2-4473-4679-8ec0-81e84dc0f7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:55.831216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b96e96a2-4473-4679-8ec0-81e84dc0f7f4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:55.832479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b96e96a2-4473-4679-8ec0-81e84dc0f7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:55.939995 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 700/1408] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:47:56.241006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a95a6b-bc5b-444c-bd07-c07df1320d29 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:56.242561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e0a95a6b-bc5b-444c-bd07-c07df1320d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:56.402952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:56.488141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a95a6b-bc5b-444c-bd07-c07df1320d29 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:56.612205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99430989-956c-4095-9c1b-33ed3b04cabf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:56.612934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99430989-956c-4095-9c1b-33ed3b04cabf service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:56.613284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99430989-956c-4095-9c1b-33ed3b04cabf service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:56.613634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99430989-956c-4095-9c1b-33ed3b04cabf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:56.615378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-99430989-956c-4095-9c1b-33ed3b04cabf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:56.744599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99430989-956c-4095-9c1b-33ed3b04cabf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:56.746121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99430989-956c-4095-9c1b-33ed3b04cabf service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:56.776322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 709/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:47:56.821423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:05.934919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=93 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:07.192452 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=24 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:12.857573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536e29f-8cef-4c7a-83ec-1ce3edd7bb9b None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:12.858151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536e29f-8cef-4c7a-83ec-1ce3edd7bb9b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:12.858151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536e29f-8cef-4c7a-83ec-1ce3edd7bb9b None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:12.859537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 701/1410] 10.222.0.17 () {54 vars in 918 bytes} [Wed Aug 24 07:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:12.865824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799369be-8d1b-4e22-8e97-c603427e1b4e None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:12.866254 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799369be-8d1b-4e22-8e97-c603427e1b4e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:12.866380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799369be-8d1b-4e22-8e97-c603427e1b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:12.942714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-799369be-8d1b-4e22-8e97-c603427e1b4e None None] MFA Rules not processed for user `36bd5aef3c034c41be036c4cc9eed376`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:12.943869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-799369be-8d1b-4e22-8e97-c603427e1b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:13.052326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 710/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 07:48:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:13.066935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcca52-765a-455e-87b0-82fcc4d115fc None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:13.067252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcca52-765a-455e-87b0-82fcc4d115fc None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:13.067556 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcca52-765a-455e-87b0-82fcc4d115fc None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:13.068868 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 702/1412] 10.222.0.17 () {54 vars in 918 bytes} [Wed Aug 24 07:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:13.073395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f9b00-5ac6-4046-b570-cce8a57cdf02 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:13.073684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f9b00-5ac6-4046-b570-cce8a57cdf02 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:13.073963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f9b00-5ac6-4046-b570-cce8a57cdf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:13.147548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:13.150553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-be9f9b00-5ac6-4046-b570-cce8a57cdf02 None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:13.151779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-be9f9b00-5ac6-4046-b570-cce8a57cdf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:13.266837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 711/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 07:48:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:48:15.660592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e28039-3f5e-46cf-b75f-6dddd1da18a7 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:15.661126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e28039-3f5e-46cf-b75f-6dddd1da18a7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:15.661126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e28039-3f5e-46cf-b75f-6dddd1da18a7 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:15.662351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:15.667652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5ef98-790d-4fb5-a0e1-488ae7f81f50 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:15.668052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5ef98-790d-4fb5-a0e1-488ae7f81f50 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:15.668214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5ef98-790d-4fb5-a0e1-488ae7f81f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:15.734766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c0e5ef98-790d-4fb5-a0e1-488ae7f81f50 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:15.735980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c0e5ef98-790d-4fb5-a0e1-488ae7f81f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:15.790507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:15.832770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:16.126010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e28039-3f5e-46cf-b75f-6dddd1da18a7 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:16.128266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b3e28039-3f5e-46cf-b75f-6dddd1da18a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:16.274518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e28039-3f5e-46cf-b75f-6dddd1da18a7 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:16.347568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:16.389392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba5d0-cb17-4fe6-a745-55ac3e680eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:16.389916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba5d0-cb17-4fe6-a745-55ac3e680eba service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:16.390191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba5d0-cb17-4fe6-a745-55ac3e680eba service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:16.390461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba5d0-cb17-4fe6-a745-55ac3e680eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:16.392068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-952ba5d0-cb17-4fe6-a745-55ac3e680eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:16.487038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba5d0-cb17-4fe6-a745-55ac3e680eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:16.488736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba5d0-cb17-4fe6-a745-55ac3e680eba service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:16.508140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 704/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:17.409512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6c2a2-729b-412a-95e7-210ae854863a None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:17.415517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6c2a2-729b-412a-95e7-210ae854863a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:17.415517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6c2a2-729b-412a-95e7-210ae854863a None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:17.415517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:48:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:17.416195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529b60-ada1-4b49-8f1e-4ce0d1e6e787 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:17.416630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529b60-ada1-4b49-8f1e-4ce0d1e6e787 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:17.416739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce529b60-ada1-4b49-8f1e-4ce0d1e6e787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:17.493729 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ce529b60-ada1-4b49-8f1e-4ce0d1e6e787 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:17.494938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ce529b60-ada1-4b49-8f1e-4ce0d1e6e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:17.522112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:17.595526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:48:17.748138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6c2a2-729b-412a-95e7-210ae854863a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:17.749654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-65d6c2a2-729b-412a-95e7-210ae854863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:17.894317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6c2a2-729b-412a-95e7-210ae854863a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:17.934766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:18.008866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d673e7b-508e-4d1b-a1c9-68660c063fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:18.010797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d673e7b-508e-4d1b-a1c9-68660c063fb5 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:18.010797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d673e7b-508e-4d1b-a1c9-68660c063fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:18.010797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d673e7b-508e-4d1b-a1c9-68660c063fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:18.011596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9d673e7b-508e-4d1b-a1c9-68660c063fb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:18.102688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d673e7b-508e-4d1b-a1c9-68660c063fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:18.104336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d673e7b-508e-4d1b-a1c9-68660c063fb5 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:18.122312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 714/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:19.015535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d8733-0296-4a59-9646-3eed973a3585 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:19.016080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d8733-0296-4a59-9646-3eed973a3585 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:19.016080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d8733-0296-4a59-9646-3eed973a3585 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:19.017396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:19.022396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7cdc-ab00-4800-bc38-bc0c45c1fc59 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:19.022840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7cdc-ab00-4800-bc38-bc0c45c1fc59 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:19.022965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7cdc-ab00-4800-bc38-bc0c45c1fc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:19.077001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:19.098834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-319d7cdc-ab00-4800-bc38-bc0c45c1fc59 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:19.100098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-319d7cdc-ab00-4800-bc38-bc0c45c1fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:19.197388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:19.346973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d8733-0296-4a59-9646-3eed973a3585 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:19.348695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-599d8733-0296-4a59-9646-3eed973a3585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:19.494067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d8733-0296-4a59-9646-3eed973a3585 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:19.506239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:19.611526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7da0c-0598-4879-8dc4-754a76d34c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:19.612067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7da0c-0598-4879-8dc4-754a76d34c73 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:19.612343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7da0c-0598-4879-8dc4-754a76d34c73 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:19.612615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7da0c-0598-4879-8dc4-754a76d34c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:19.614210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-52c7da0c-0598-4879-8dc4-754a76d34c73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:19.703504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7da0c-0598-4879-8dc4-754a76d34c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:19.712698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7da0c-0598-4879-8dc4-754a76d34c73 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:19.723799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 707/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:20.599101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1a34-c09b-43d7-b68b-ad24c3fc41d6 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:20.599694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1a34-c09b-43d7-b68b-ad24c3fc41d6 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:20.599694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1a34-c09b-43d7-b68b-ad24c3fc41d6 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:20.601053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:20.606019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65605e-7203-45bf-96f3-c8772e53c6e4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:20.606423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65605e-7203-45bf-96f3-c8772e53c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:20.606575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65605e-7203-45bf-96f3-c8772e53c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:20.626509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:20.683905 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7f65605e-7203-45bf-96f3-c8772e53c6e4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:20.685153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7f65605e-7203-45bf-96f3-c8772e53c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:20.781239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:20.932117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad1a34-c09b-43d7-b68b-ad24c3fc41d6 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:20.933559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d6ad1a34-c09b-43d7-b68b-ad24c3fc41d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:21.046700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:21.083927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad1a34-c09b-43d7-b68b-ad24c3fc41d6 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:21.198781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc492d84-ea17-4e01-bc59-5bb862c60be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:21.199329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc492d84-ea17-4e01-bc59-5bb862c60be0 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:21.199614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc492d84-ea17-4e01-bc59-5bb862c60be0 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:21.199893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc492d84-ea17-4e01-bc59-5bb862c60be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:21.201496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-dc492d84-ea17-4e01-bc59-5bb862c60be0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:21.278772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:21.292375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc492d84-ea17-4e01-bc59-5bb862c60be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:21.293991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc492d84-ea17-4e01-bc59-5bb862c60be0 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:21.312023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 717/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:22.184154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bd4f8-9476-434c-8fee-1e9caead321d None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:22.184718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bd4f8-9476-434c-8fee-1e9caead321d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:22.184718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bd4f8-9476-434c-8fee-1e9caead321d None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:22.186095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:22.191993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd94b-a316-4943-88c7-38802c81e975 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:22.192397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd94b-a316-4943-88c7-38802c81e975 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:22.192573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd94b-a316-4943-88c7-38802c81e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:22.268915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8cbcd94b-a316-4943-88c7-38802c81e975 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:22.270122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8cbcd94b-a316-4943-88c7-38802c81e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:22.368153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:22.531150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bd4f8-9476-434c-8fee-1e9caead321d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:22.549604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-819bd4f8-9476-434c-8fee-1e9caead321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:22.623603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:22.685026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bd4f8-9476-434c-8fee-1e9caead321d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:22.799308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717b213-2e9b-4b3a-bb7b-ad4f1d722346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:22.800215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717b213-2e9b-4b3a-bb7b-ad4f1d722346 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:22.800490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717b213-2e9b-4b3a-bb7b-ad4f1d722346 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:22.800762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717b213-2e9b-4b3a-bb7b-ad4f1d722346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:22.802395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9717b213-2e9b-4b3a-bb7b-ad4f1d722346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:22.850369 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:22.891596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717b213-2e9b-4b3a-bb7b-ad4f1d722346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:22.894080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717b213-2e9b-4b3a-bb7b-ad4f1d722346 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:22.912821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 710/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:23.814368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f3a0c-3168-4971-8cf4-cddcea54697c None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:23.815001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f3a0c-3168-4971-8cf4-cddcea54697c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:23.815001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f3a0c-3168-4971-8cf4-cddcea54697c None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:23.816383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:23.821597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40573353-3fbd-4dfc-861e-24f5a1c4cece None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:23.822024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40573353-3fbd-4dfc-861e-24f5a1c4cece None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:23.822199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40573353-3fbd-4dfc-861e-24f5a1c4cece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:23.897993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-40573353-3fbd-4dfc-861e-24f5a1c4cece None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:23.899199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-40573353-3fbd-4dfc-861e-24f5a1c4cece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:23.995014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:24.145939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f3a0c-3168-4971-8cf4-cddcea54697c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:24.147418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-279f3a0c-3168-4971-8cf4-cddcea54697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:24.196558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:24.292930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f3a0c-3168-4971-8cf4-cddcea54697c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:24.409542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd8202-ffbf-42eb-abcf-4cb1270fddb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:24.410088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd8202-ffbf-42eb-abcf-4cb1270fddb1 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:24.410369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd8202-ffbf-42eb-abcf-4cb1270fddb1 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:24.410642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd8202-ffbf-42eb-abcf-4cb1270fddb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:24.412289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7dcd8202-ffbf-42eb-abcf-4cb1270fddb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:24.419137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:24.503930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd8202-ffbf-42eb-abcf-4cb1270fddb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:24.505568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd8202-ffbf-42eb-abcf-4cb1270fddb1 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:24.524733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 720/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:25.468709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5a5f6-050b-4c04-964c-9de7bc87645e None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:25.469283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5a5f6-050b-4c04-964c-9de7bc87645e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:25.469283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5a5f6-050b-4c04-964c-9de7bc87645e None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:25.470807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:25.478020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf81a3-87ba-48da-83e3-97f83224cb8c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:25.478568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf81a3-87ba-48da-83e3-97f83224cb8c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:25.478568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf81a3-87ba-48da-83e3-97f83224cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:25.576111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-30cf81a3-87ba-48da-83e3-97f83224cb8c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:25.577332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-30cf81a3-87ba-48da-83e3-97f83224cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:25.647916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:25.677232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:25.845204 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5a5f6-050b-4c04-964c-9de7bc87645e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:25.847927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-16d5a5f6-050b-4c04-964c-9de7bc87645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:25.866063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:25.995837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5a5f6-050b-4c04-964c-9de7bc87645e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:26.084086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:26.108921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f298-6792-4c0f-8e3c-059eadb69e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:26.109520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f298-6792-4c0f-8e3c-059eadb69e82 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:26.109796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f298-6792-4c0f-8e3c-059eadb69e82 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:26.110065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f298-6792-4c0f-8e3c-059eadb69e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:26.112373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4b80f298-6792-4c0f-8e3c-059eadb69e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:26.204608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f298-6792-4c0f-8e3c-059eadb69e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:26.206250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f298-6792-4c0f-8e3c-059eadb69e82 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:26.223853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 713/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:27.085892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f51e-d838-4c88-8723-3cff9a4d59d0 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:27.086482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f51e-d838-4c88-8723-3cff9a4d59d0 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:27.086482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04f51e-d838-4c88-8723-3cff9a4d59d0 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:27.087882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:27.092741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cf6bb-4d5e-492d-ac49-fe7c8162c406 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:27.093179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cf6bb-4d5e-492d-ac49-fe7c8162c406 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:27.093373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cf6bb-4d5e-492d-ac49-fe7c8162c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:27.170413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-334cf6bb-4d5e-492d-ac49-fe7c8162c406 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:27.171665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-334cf6bb-4d5e-492d-ac49-fe7c8162c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:27.214582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.269438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:27.422999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04f51e-d838-4c88-8723-3cff9a4d59d0 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:27.424622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-df04f51e-d838-4c88-8723-3cff9a4d59d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:27.580972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04f51e-d838-4c88-8723-3cff9a4d59d0 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:27.638612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:27.698886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d96e8-88b9-4eea-bc67-cf96f7b915b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:27.699642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d96e8-88b9-4eea-bc67-cf96f7b915b5 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:27.699924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d96e8-88b9-4eea-bc67-cf96f7b915b5 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:27.700195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d96e8-88b9-4eea-bc67-cf96f7b915b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:27.701797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5d0d96e8-88b9-4eea-bc67-cf96f7b915b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:27.791484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d96e8-88b9-4eea-bc67-cf96f7b915b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:27.793100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d96e8-88b9-4eea-bc67-cf96f7b915b5 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:27.811253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 723/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:28.708007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f755f3d-97c1-4df8-9129-7447e2ad8b2b None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:28.708486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f755f3d-97c1-4df8-9129-7447e2ad8b2b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:28.708584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f755f3d-97c1-4df8-9129-7447e2ad8b2b None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:28.709935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:28.714959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db4e94-5b63-4c32-ab19-2e8ae47083a5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:28.715414 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db4e94-5b63-4c32-ab19-2e8ae47083a5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:28.715580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db4e94-5b63-4c32-ab19-2e8ae47083a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:28.791502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-13db4e94-5b63-4c32-ab19-2e8ae47083a5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:28.792711 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-13db4e94-5b63-4c32-ab19-2e8ae47083a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:28.794770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:28.890753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:48:29.041336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f755f3d-97c1-4df8-9129-7447e2ad8b2b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:29.042862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0f755f3d-97c1-4df8-9129-7447e2ad8b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:29.191386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f755f3d-97c1-4df8-9129-7447e2ad8b2b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:29.218401 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:29.308097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218cd45-1ecb-41dd-80f7-ae1cc83194be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:29.308600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218cd45-1ecb-41dd-80f7-ae1cc83194be service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:29.308885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218cd45-1ecb-41dd-80f7-ae1cc83194be service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:29.309160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218cd45-1ecb-41dd-80f7-ae1cc83194be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:29.310763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a218cd45-1ecb-41dd-80f7-ae1cc83194be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:29.399641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218cd45-1ecb-41dd-80f7-ae1cc83194be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:29.401234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218cd45-1ecb-41dd-80f7-ae1cc83194be service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:29.419643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 716/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:31.243412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc305d-a75f-4b24-88fe-7ec3b85812d8 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:31.243982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc305d-a75f-4b24-88fe-7ec3b85812d8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:31.243982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc305d-a75f-4b24-88fe-7ec3b85812d8 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:31.245324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:31.250540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74731bc1-c149-426c-88b3-8b4ed8e5abf0 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:31.250961 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74731bc1-c149-426c-88b3-8b4ed8e5abf0 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:31.251078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74731bc1-c149-426c-88b3-8b4ed8e5abf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:31.291678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:31.316416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-74731bc1-c149-426c-88b3-8b4ed8e5abf0 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:31.317876 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-74731bc1-c149-426c-88b3-8b4ed8e5abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:31.416339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:31.706324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc305d-a75f-4b24-88fe-7ec3b85812d8 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:31.707898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e1cc305d-a75f-4b24-88fe-7ec3b85812d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:31.810077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc305d-a75f-4b24-88fe-7ec3b85812d8 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:31.843210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:31.888384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f3a2-5759-4c21-9454-96427d9d207a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:31.888992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f3a2-5759-4c21-9454-96427d9d207a service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:31.889274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f3a2-5759-4c21-9454-96427d9d207a service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:31.889547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f3a2-5759-4c21-9454-96427d9d207a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:31.891160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ef31f3a2-5759-4c21-9454-96427d9d207a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:32.003491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f3a2-5759-4c21-9454-96427d9d207a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:32.004953 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f3a2-5759-4c21-9454-96427d9d207a service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:32.023904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 726/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:34.093360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bc2d-f267-4e79-a04f-b6c8eb955720 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:34.093979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bc2d-f267-4e79-a04f-b6c8eb955720 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:34.093979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899bc2d-f267-4e79-a04f-b6c8eb955720 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:34.095276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:34.100478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f054d-60a9-4719-8404-b3e9ff3813f7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:34.100906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f054d-60a9-4719-8404-b3e9ff3813f7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:34.101066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f054d-60a9-4719-8404-b3e9ff3813f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:34.167598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e14f054d-60a9-4719-8404-b3e9ff3813f7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:34.168802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e14f054d-60a9-4719-8404-b3e9ff3813f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:34.182376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:34.269028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:34.559799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899bc2d-f267-4e79-a04f-b6c8eb955720 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:34.561364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a899bc2d-f267-4e79-a04f-b6c8eb955720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:34.665762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899bc2d-f267-4e79-a04f-b6c8eb955720 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:34.678069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:34.740800 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cd3c6-a0b5-46ad-b772-87b6fecd45ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:34.741402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd3c6-a0b5-46ad-b772-87b6fecd45ef service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:34.741682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd3c6-a0b5-46ad-b772-87b6fecd45ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:34.741955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cd3c6-a0b5-46ad-b772-87b6fecd45ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:34.743594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-161cd3c6-a0b5-46ad-b772-87b6fecd45ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:34.864034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cd3c6-a0b5-46ad-b772-87b6fecd45ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:34.865495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cd3c6-a0b5-46ad-b772-87b6fecd45ef service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:34.883953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 719/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:37.237680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6497ac-9596-4741-9e81-50c089e3fa2f None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:37.238218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6497ac-9596-4741-9e81-50c089e3fa2f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:37.238218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6497ac-9596-4741-9e81-50c089e3fa2f None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:37.239618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:37.244864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95d4a5-efa2-4b0c-9104-b988bb4308b5 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:37.245298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95d4a5-efa2-4b0c-9104-b988bb4308b5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:37.245429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95d4a5-efa2-4b0c-9104-b988bb4308b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:37.293340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:37.312430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-bd95d4a5-efa2-4b0c-9104-b988bb4308b5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:37.313634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bd95d4a5-efa2-4b0c-9104-b988bb4308b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:37.414589 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:48:37.702947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6497ac-9596-4741-9e81-50c089e3fa2f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:37.704599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8b6497ac-9596-4741-9e81-50c089e3fa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:37.809304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6497ac-9596-4741-9e81-50c089e3fa2f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:37.849196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:37.883265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ae798-1935-4988-a6e5-1cc60a3b91c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:37.883902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ae798-1935-4988-a6e5-1cc60a3b91c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:37.884185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ae798-1935-4988-a6e5-1cc60a3b91c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:37.884457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ae798-1935-4988-a6e5-1cc60a3b91c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:37.886093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c02ae798-1935-4988-a6e5-1cc60a3b91c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:37.995604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ae798-1935-4988-a6e5-1cc60a3b91c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:37.997049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ae798-1935-4988-a6e5-1cc60a3b91c0 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:38.014595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 729/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:40.050299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab78f4f-4673-4a5a-b9c5-88cd46b8817b None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:40.050838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab78f4f-4673-4a5a-b9c5-88cd46b8817b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:40.050956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab78f4f-4673-4a5a-b9c5-88cd46b8817b None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:40.052246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:40.057685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdb369-2f98-4968-95b2-d2a40a83dca0 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:40.058060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdb369-2f98-4968-95b2-d2a40a83dca0 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:40.058251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfdb369-2f98-4968-95b2-d2a40a83dca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:40.123444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2cfdb369-2f98-4968-95b2-d2a40a83dca0 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:40.124655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2cfdb369-2f98-4968-95b2-d2a40a83dca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:40.146118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:40.222243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:40.511487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab78f4f-4673-4a5a-b9c5-88cd46b8817b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:40.513050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cab78f4f-4673-4a5a-b9c5-88cd46b8817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:40.619173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab78f4f-4673-4a5a-b9c5-88cd46b8817b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:40.638846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:40.693742 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3341c9a-1b04-43f2-8346-16c323c23aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:40.694350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3341c9a-1b04-43f2-8346-16c323c23aaa service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:40.694631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3341c9a-1b04-43f2-8346-16c323c23aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:40.694905 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3341c9a-1b04-43f2-8346-16c323c23aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:40.696576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f3341c9a-1b04-43f2-8346-16c323c23aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:40.805591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3341c9a-1b04-43f2-8346-16c323c23aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:40.807071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3341c9a-1b04-43f2-8346-16c323c23aaa service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:40.826872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 722/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:42.802795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013a7e7-bc1a-4ef5-9c5a-f7e7f9988395 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:42.803403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013a7e7-bc1a-4ef5-9c5a-f7e7f9988395 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:42.803403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013a7e7-bc1a-4ef5-9c5a-f7e7f9988395 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:42.804836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:42.810437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249b36a-661e-4a63-a782-f085d25a6f3d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:42.810861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249b36a-661e-4a63-a782-f085d25a6f3d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:42.813083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249b36a-661e-4a63-a782-f085d25a6f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:42.873772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:42.876845 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8249b36a-661e-4a63-a782-f085d25a6f3d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:42.878052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8249b36a-661e-4a63-a782-f085d25a6f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:42.976256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:43.265420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013a7e7-bc1a-4ef5-9c5a-f7e7f9988395 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:43.267507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5013a7e7-bc1a-4ef5-9c5a-f7e7f9988395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:43.370867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013a7e7-bc1a-4ef5-9c5a-f7e7f9988395 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:43.420212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:43.446548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e24ff-5896-4308-9c90-b13743794142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:43.447149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e24ff-5896-4308-9c90-b13743794142 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:43.447463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e24ff-5896-4308-9c90-b13743794142 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:43.447737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e24ff-5896-4308-9c90-b13743794142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:43.449342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cc5e24ff-5896-4308-9c90-b13743794142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:43.561293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e24ff-5896-4308-9c90-b13743794142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:43.562664 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e24ff-5896-4308-9c90-b13743794142 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:43.582509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 732/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:45.574272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45572d-02db-4ffd-949c-51a6266170cb None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:45.574840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45572d-02db-4ffd-949c-51a6266170cb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:45.574840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45572d-02db-4ffd-949c-51a6266170cb None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:45.576193 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:45.581969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e833ec-f04b-4998-be5a-a3b1701ef497 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:45.582415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e833ec-f04b-4998-be5a-a3b1701ef497 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:45.582521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e833ec-f04b-4998-be5a-a3b1701ef497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:45.647488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d5e833ec-f04b-4998-be5a-a3b1701ef497 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:45.648624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d5e833ec-f04b-4998-be5a-a3b1701ef497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:45.677461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:45.745325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:46.038710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45572d-02db-4ffd-949c-51a6266170cb None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:46.042135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6d45572d-02db-4ffd-949c-51a6266170cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:46.145035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45572d-02db-4ffd-949c-51a6266170cb None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:46.173894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:46.219528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12976835-b096-4f63-9159-8aa24cdae567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:46.220705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12976835-b096-4f63-9159-8aa24cdae567 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:46.220974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12976835-b096-4f63-9159-8aa24cdae567 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:46.221236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12976835-b096-4f63-9159-8aa24cdae567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:46.222814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-12976835-b096-4f63-9159-8aa24cdae567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:46.330711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12976835-b096-4f63-9159-8aa24cdae567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:46.332108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12976835-b096-4f63-9159-8aa24cdae567 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:46.352387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 725/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:48.349036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba318ca7-4c8a-4240-b316-d57d68ca6aa7 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:48.349574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba318ca7-4c8a-4240-b316-d57d68ca6aa7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:48.349574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba318ca7-4c8a-4240-b316-d57d68ca6aa7 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:48.350937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:48.356377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae51dc-12f5-46b8-bce2-ed2a77f2f6f3 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:48.356825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae51dc-12f5-46b8-bce2-ed2a77f2f6f3 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:48.356932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae51dc-12f5-46b8-bce2-ed2a77f2f6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:48.423214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2bae51dc-12f5-46b8-bce2-ed2a77f2f6f3 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:48.424464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2bae51dc-12f5-46b8-bce2-ed2a77f2f6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:48.432746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:48.521391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:48.809028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba318ca7-4c8a-4240-b316-d57d68ca6aa7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:48.810614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ba318ca7-4c8a-4240-b316-d57d68ca6aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:48.917308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba318ca7-4c8a-4240-b316-d57d68ca6aa7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:48.972450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:48.991138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919626fd-027c-4307-872b-f790449fcf7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:48.991777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919626fd-027c-4307-872b-f790449fcf7e service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:48.992064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919626fd-027c-4307-872b-f790449fcf7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:48.992417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919626fd-027c-4307-872b-f790449fcf7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:48.993934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-919626fd-027c-4307-872b-f790449fcf7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:49.102313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919626fd-027c-4307-872b-f790449fcf7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:49.103805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919626fd-027c-4307-872b-f790449fcf7e service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:49.122702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 735/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:51.069753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb060-fc11-4626-8914-a9b66b83ba51 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:51.070292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb060-fc11-4626-8914-a9b66b83ba51 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:51.070292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb060-fc11-4626-8914-a9b66b83ba51 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:51.071649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:51.076866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dce22-c6cd-4222-8b67-d940b96ecec5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:51.077291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dce22-c6cd-4222-8b67-d940b96ecec5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:51.077453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dce22-c6cd-4222-8b67-d940b96ecec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:51.144506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-b74dce22-c6cd-4222-8b67-d940b96ecec5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:51.145701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b74dce22-c6cd-4222-8b67-d940b96ecec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:51.182909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:51.241140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:51.527175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb060-fc11-4626-8914-a9b66b83ba51 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:51.528751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-08fdb060-fc11-4626-8914-a9b66b83ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:51.634065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb060-fc11-4626-8914-a9b66b83ba51 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:51.671904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:51.708717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948768f9-6703-45dd-89fb-fc5b5c32ea3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:51.709326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948768f9-6703-45dd-89fb-fc5b5c32ea3f service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:51.709608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948768f9-6703-45dd-89fb-fc5b5c32ea3f service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:51.709886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948768f9-6703-45dd-89fb-fc5b5c32ea3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:51.711525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-948768f9-6703-45dd-89fb-fc5b5c32ea3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:51.821548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948768f9-6703-45dd-89fb-fc5b5c32ea3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:51.823003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948768f9-6703-45dd-89fb-fc5b5c32ea3f service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:51.842135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 728/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:53.784828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd9935-5cf6-46af-9d89-e46982f32770 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:53.785426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd9935-5cf6-46af-9d89-e46982f32770 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:53.785426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd9935-5cf6-46af-9d89-e46982f32770 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:53.786786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:53.792153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170554f0-d88a-417c-9f3e-fa83aa8b46b1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:53.792606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170554f0-d88a-417c-9f3e-fa83aa8b46b1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:53.792847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170554f0-d88a-417c-9f3e-fa83aa8b46b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:53.861143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-170554f0-d88a-417c-9f3e-fa83aa8b46b1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:53.862351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-170554f0-d88a-417c-9f3e-fa83aa8b46b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:53.881282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:53.963781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:54.249442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd9935-5cf6-46af-9d89-e46982f32770 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:54.251612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-febd9935-5cf6-46af-9d89-e46982f32770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:54.356901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd9935-5cf6-46af-9d89-e46982f32770 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:54.423997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:54.430718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63927f20-7873-4b0c-b32f-45b9cfdc1c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:54.431352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63927f20-7873-4b0c-b32f-45b9cfdc1c69 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:54.431635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63927f20-7873-4b0c-b32f-45b9cfdc1c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:54.431911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63927f20-7873-4b0c-b32f-45b9cfdc1c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:54.433498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-63927f20-7873-4b0c-b32f-45b9cfdc1c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:54.543479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63927f20-7873-4b0c-b32f-45b9cfdc1c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:54.544848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63927f20-7873-4b0c-b32f-45b9cfdc1c69 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:54.563003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 738/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:48:56.543021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7fdc5-8fda-459a-b298-c3f2f7b2151a None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:56.543859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7fdc5-8fda-459a-b298-c3f2f7b2151a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:56.543859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7fdc5-8fda-459a-b298-c3f2f7b2151a None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:56.544921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:56.551194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6f9cd-066f-4d9e-9074-a59e518e4a60 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:56.551686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6f9cd-066f-4d9e-9074-a59e518e4a60 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:56.551793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6f9cd-066f-4d9e-9074-a59e518e4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:56.617479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-1ce6f9cd-066f-4d9e-9074-a59e518e4a60 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:56.618620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1ce6f9cd-066f-4d9e-9074-a59e518e4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:56.667593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:56.716657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:48:57.005190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7fdc5-8fda-459a-b298-c3f2f7b2151a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:57.006711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-afb7fdc5-8fda-459a-b298-c3f2f7b2151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:57.108788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7fdc5-8fda-459a-b298-c3f2f7b2151a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:57.155642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:57.183123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c2ab-b812-4d7a-8b3b-6dff0269d8c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:57.183881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c2ab-b812-4d7a-8b3b-6dff0269d8c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:57.184164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c2ab-b812-4d7a-8b3b-6dff0269d8c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:57.184437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c2ab-b812-4d7a-8b3b-6dff0269d8c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:57.186082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1401c2ab-b812-4d7a-8b3b-6dff0269d8c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:57.294345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401c2ab-b812-4d7a-8b3b-6dff0269d8c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:57.295744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401c2ab-b812-4d7a-8b3b-6dff0269d8c7 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:57.314703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 731/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:06.714747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=22 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:07.312308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=66 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:16.972465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6318bb-54ed-4539-b6fe-676be46fef84 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:16.972992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6318bb-54ed-4539-b6fe-676be46fef84 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:16.972992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6318bb-54ed-4539-b6fe-676be46fef84 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:16.974287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 740/1471] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:16.980624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814388-91b4-4306-8952-79744a40f6f5 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:16.981053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814388-91b4-4306-8952-79744a40f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:16.981179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814388-91b4-4306-8952-79744a40f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:17.047678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-90814388-91b4-4306-8952-79744a40f6f5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:17.048971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-90814388-91b4-4306-8952-79744a40f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:17.144170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 732/1472] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:17.444931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c3ca-87af-4871-ab4b-a69b492fd87b None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:17.445236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c3ca-87af-4871-ab4b-a69b492fd87b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:17.445507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c3ca-87af-4871-ab4b-a69b492fd87b None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:17.446827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 741/1473] 10.222.0.17 () {54 vars in 967 bytes} [Wed Aug 24 07:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:17.451886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920fc56-d473-424b-9c41-aa151238415f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:17.452170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920fc56-d473-424b-9c41-aa151238415f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:17.452438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920fc56-d473-424b-9c41-aa151238415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:17.528343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f920fc56-d473-424b-9c41-aa151238415f None None] MFA Rules not processed for user `f436ac7cc2f04919bb0ec1ad9fca5622`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:17.529828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f920fc56-d473-424b-9c41-aa151238415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:17.551351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:17.607487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 733/1474] 10.222.0.17 () {58 vars in 1064 bytes} [Wed Aug 24 07:49:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:17.615892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c3ca-87af-4871-ab4b-a69b492fd87b None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:17.617326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7919c3ca-87af-4871-ab4b-a69b492fd87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:17.719910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c3ca-87af-4871-ab4b-a69b492fd87b None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:17.791753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442af5-1726-4e5c-8efd-7dc2bb4b2a12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f436ac7cc2f04919bb0ec1ad9fca5622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:17.792354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442af5-1726-4e5c-8efd-7dc2bb4b2a12 service glance] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:17.792641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442af5-1726-4e5c-8efd-7dc2bb4b2a12 service glance] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:17.792920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442af5-1726-4e5c-8efd-7dc2bb4b2a12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:17.794499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-86442af5-1726-4e5c-8efd-7dc2bb4b2a12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:17.851484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:17.907256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442af5-1726-4e5c-8efd-7dc2bb4b2a12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:17.909259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442af5-1726-4e5c-8efd-7dc2bb4b2a12 service glance] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:17.927713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 742/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:19.951188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae629-1c41-4105-94c1-3c48090e67a5 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:19.951726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae629-1c41-4105-94c1-3c48090e67a5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:19.951726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae629-1c41-4105-94c1-3c48090e67a5 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:19.952999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 734/1476] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:19.958672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9816d-6b2a-48d9-bdcb-8127104adc7e None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:19.959113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9816d-6b2a-48d9-bdcb-8127104adc7e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:19.959260 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9816d-6b2a-48d9-bdcb-8127104adc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:20.026052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-54c9816d-6b2a-48d9-bdcb-8127104adc7e None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:20.027252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-54c9816d-6b2a-48d9-bdcb-8127104adc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:20.122881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 743/1477] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:20.403195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae629-1c41-4105-94c1-3c48090e67a5 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:20.404755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-77bae629-1c41-4105-94c1-3c48090e67a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:20.531151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae629-1c41-4105-94c1-3c48090e67a5 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:20.580464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:20.628258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad9811-4f6f-43ad-930f-189354aefa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:20.628777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad9811-4f6f-43ad-930f-189354aefa55 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:20.629056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad9811-4f6f-43ad-930f-189354aefa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:20.629330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad9811-4f6f-43ad-930f-189354aefa55 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:20.629959 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad9811-4f6f-43ad-930f-189354aefa55 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:20.631757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WARNING py.warnings [None req-25ad9811-4f6f-43ad-930f-189354aefa55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:49:20.631757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: warnings.warn(msg) Aug 24 07:49:20.631757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: Aug 24 07:49:20.632894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad9811-4f6f-43ad-930f-189354aefa55 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:20.651966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 735/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:20 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:49:22.576648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae273f-74d5-4ce2-98e2-ec04d442cb2e None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:22.577252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae273f-74d5-4ce2-98e2-ec04d442cb2e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:22.577252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae273f-74d5-4ce2-98e2-ec04d442cb2e None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:22.578521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 744/1479] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:22.583911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7506d-8e47-419a-97dd-4cf8a312916a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:22.584334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7506d-8e47-419a-97dd-4cf8a312916a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:22.584467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7506d-8e47-419a-97dd-4cf8a312916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:22.652394 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-54c7506d-8e47-419a-97dd-4cf8a312916a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:22.653634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-54c7506d-8e47-419a-97dd-4cf8a312916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:22.749803 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 736/1480] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:23.052347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae273f-74d5-4ce2-98e2-ec04d442cb2e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:23.053872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-60ae273f-74d5-4ce2-98e2-ec04d442cb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:23.063609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:23.204324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae273f-74d5-4ce2-98e2-ec04d442cb2e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:23.283926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:23.317387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e4174-30fe-4db1-b899-4cfc929759de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:23.317921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e4174-30fe-4db1-b899-4cfc929759de service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:23.318205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e4174-30fe-4db1-b899-4cfc929759de service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:23.318480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e4174-30fe-4db1-b899-4cfc929759de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:23.320108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ab9e4174-30fe-4db1-b899-4cfc929759de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:23.415122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e4174-30fe-4db1-b899-4cfc929759de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:23.416820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e4174-30fe-4db1-b899-4cfc929759de service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:23.435665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 745/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:25.749247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e4f3-af6a-449d-88ad-553c871e1ff5 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:25.749820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e4f3-af6a-449d-88ad-553c871e1ff5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:25.749820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e4f3-af6a-449d-88ad-553c871e1ff5 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:25.751110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 737/1482] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:25.756578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270d9a8-6bea-4a0a-9632-83a70fa31bbf None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:25.757024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270d9a8-6bea-4a0a-9632-83a70fa31bbf None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:25.757134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270d9a8-6bea-4a0a-9632-83a70fa31bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:25.827312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8270d9a8-6bea-4a0a-9632-83a70fa31bbf None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:25.828586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8270d9a8-6bea-4a0a-9632-83a70fa31bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:25.876459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:25.928909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 746/1483] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:26.216346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e4f3-af6a-449d-88ad-553c871e1ff5 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:26.217892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a071e4f3-af6a-449d-88ad-553c871e1ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:26.242877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:26.323738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e4f3-af6a-449d-88ad-553c871e1ff5 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:26.401328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af68fb3-26c3-4a0a-a196-418d306210db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:26.402002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af68fb3-26c3-4a0a-a196-418d306210db service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:26.402285 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af68fb3-26c3-4a0a-a196-418d306210db service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:26.402558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af68fb3-26c3-4a0a-a196-418d306210db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:26.404185 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6af68fb3-26c3-4a0a-a196-418d306210db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:26.479167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:26.516468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af68fb3-26c3-4a0a-a196-418d306210db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:26.518600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af68fb3-26c3-4a0a-a196-418d306210db service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:26.541408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 738/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:28.522896 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf666f8-54c2-4823-94f5-1bd36ceae7bb None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.523489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf666f8-54c2-4823-94f5-1bd36ceae7bb None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.523489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf666f8-54c2-4823-94f5-1bd36ceae7bb None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.524814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 747/1485] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:28.529931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede3f4e-ef60-4734-a79f-2e840f738fc9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.530356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede3f4e-ef60-4734-a79f-2e840f738fc9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.530462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede3f4e-ef60-4734-a79f-2e840f738fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.597084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-bede3f4e-ef60-4734-a79f-2e840f738fc9 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:28.598273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bede3f4e-ef60-4734-a79f-2e840f738fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:28.695791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 739/1486] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:28.983458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf666f8-54c2-4823-94f5-1bd36ceae7bb None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:28.985011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-fbf666f8-54c2-4823-94f5-1bd36ceae7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:29.094637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf666f8-54c2-4823-94f5-1bd36ceae7bb None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:29.164632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:29.166394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c926-a9dd-4558-b270-46e048372650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:29.166998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c926-a9dd-4558-b270-46e048372650 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:29.167275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c926-a9dd-4558-b270-46e048372650 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:29.167570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c926-a9dd-4558-b270-46e048372650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:29.169162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1602c926-a9dd-4558-b270-46e048372650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:29.278462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602c926-a9dd-4558-b270-46e048372650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:29.279953 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602c926-a9dd-4558-b270-46e048372650 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:29.297682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 748/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:31.383062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814886a-df22-4b7c-b5d3-27c569927a95 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:31.383673 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814886a-df22-4b7c-b5d3-27c569927a95 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:31.383673 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814886a-df22-4b7c-b5d3-27c569927a95 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:31.384995 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 740/1488] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:31.390322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449030f9-6efe-44f8-b672-de3e92aa9e6e None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:31.390720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449030f9-6efe-44f8-b672-de3e92aa9e6e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:31.390883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449030f9-6efe-44f8-b672-de3e92aa9e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:31.457251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-449030f9-6efe-44f8-b672-de3e92aa9e6e None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:31.458498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-449030f9-6efe-44f8-b672-de3e92aa9e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:31.513652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:31.557165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 749/1489] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:31.852607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814886a-df22-4b7c-b5d3-27c569927a95 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:31.854154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5814886a-df22-4b7c-b5d3-27c569927a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:31.890064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:31.962028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814886a-df22-4b7c-b5d3-27c569927a95 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:32.034895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec5d4d-626a-406e-9905-2f717949198e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:32.035527 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec5d4d-626a-406e-9905-2f717949198e service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.035812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec5d4d-626a-406e-9905-2f717949198e service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.036087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec5d4d-626a-406e-9905-2f717949198e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.037701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-63ec5d4d-626a-406e-9905-2f717949198e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:32.118916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:32.147885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec5d4d-626a-406e-9905-2f717949198e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:32.149368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec5d4d-626a-406e-9905-2f717949198e service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:32.168139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 741/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:34.505765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c5396-6bad-4998-b8de-6d4fc9a948c2 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:34.506314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c5396-6bad-4998-b8de-6d4fc9a948c2 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:34.506314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c5396-6bad-4998-b8de-6d4fc9a948c2 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:34.507698 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 750/1491] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 24 07:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:34.512870 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff1d1a-cf42-4d70-a4d9-abb6c7345ad6 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:34.513273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff1d1a-cf42-4d70-a4d9-abb6c7345ad6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:34.513418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff1d1a-cf42-4d70-a4d9-abb6c7345ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:34.580521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7fff1d1a-cf42-4d70-a4d9-abb6c7345ad6 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:34.581717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7fff1d1a-cf42-4d70-a4d9-abb6c7345ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:34.676516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 742/1492] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:49:34.972569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c5396-6bad-4998-b8de-6d4fc9a948c2 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:34.974102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-216c5396-6bad-4998-b8de-6d4fc9a948c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:35.079791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c5396-6bad-4998-b8de-6d4fc9a948c2 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:35.153361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0b6c5-f5c3-4ef6-91aa-60141511acda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:35.153970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0b6c5-f5c3-4ef6-91aa-60141511acda service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:35.154250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0b6c5-f5c3-4ef6-91aa-60141511acda service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:35.154521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0b6c5-f5c3-4ef6-91aa-60141511acda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:35.156162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3ec0b6c5-f5c3-4ef6-91aa-60141511acda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:35.165298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:35.265366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0b6c5-f5c3-4ef6-91aa-60141511acda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:35.266815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0b6c5-f5c3-4ef6-91aa-60141511acda service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:35.285719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 751/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:49:44.674712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=82 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:45.282382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=50 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.045806 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761039c9-99f1-4d02-929f-7c62632d1883 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.046918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761039c9-99f1-4d02-929f-7c62632d1883 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.046918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761039c9-99f1-4d02-929f-7c62632d1883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.122713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-761039c9-99f1-4d02-929f-7c62632d1883 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:56.123926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-761039c9-99f1-4d02-929f-7c62632d1883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:56.220222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 743/1494] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:56.228287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921efac-b62e-4ad4-b4cf-a7541f5f4d5d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.228789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921efac-b62e-4ad4-b4cf-a7541f5f4d5d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.228892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921efac-b62e-4ad4-b4cf-a7541f5f4d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.307423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3921efac-b62e-4ad4-b4cf-a7541f5f4d5d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:56.308559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3921efac-b62e-4ad4-b4cf-a7541f5f4d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:56.408550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 752/1495] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:56.413239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761039c9-99f1-4d02-929f-7c62632d1883 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.414448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-761039c9-99f1-4d02-929f-7c62632d1883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:56.426231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761039c9-99f1-4d02-929f-7c62632d1883 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.487049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.520873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.521468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.521741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.522012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.522642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:56.522939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.523963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WARNING py.warnings [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:50:56.523963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: warnings.warn(msg) Aug 24 07:50:56.523963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: Aug 24 07:50:56.524836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.535924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 744/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:56.544098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921efac-b62e-4ad4-b4cf-a7541f5f4d5d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.553510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921efac-b62e-4ad4-b4cf-a7541f5f4d5d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.615418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.648745 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.649348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.649629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.649910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.650597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.653331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WARNING py.warnings [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:50:56.653331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: warnings.warn(msg) Aug 24 07:50:56.653331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: Aug 24 07:50:56.654598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.776822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 753/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:50:56 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:56.781025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.782522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:56.817747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd99846-91c8-4274-9f6a-a44f34388f57 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.912204 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.912728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.913032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.913301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.913951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.914958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WARNING py.warnings [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:50:56.914958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: warnings.warn(msg) Aug 24 07:50:56.914958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: Aug 24 07:50:56.916190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.042718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 745/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:50:56 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:57.048092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.051600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:57.115179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8a2b-7cf6-473d-bc42-99f9179205a7 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.198849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.209077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.211892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.211892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.211892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.211892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.211892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WARNING py.warnings [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:50:57.211892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: warnings.warn(msg) Aug 24 07:50:57.211892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: Aug 24 07:50:57.212839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.225693 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 754/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:50:57.229817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.231364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:57.244076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42facab-2a5c-4c6f-a442-4b475eb1e3df admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.269037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.339644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca32d7-5e98-4639-8c8d-93d7e27bd4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.340258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca32d7-5e98-4639-8c8d-93d7e27bd4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.340548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca32d7-5e98-4639-8c8d-93d7e27bd4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.340830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca32d7-5e98-4639-8c8d-93d7e27bd4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.341472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca32d7-5e98-4639-8c8d-93d7e27bd4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.342511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WARNING py.warnings [None req-1aca32d7-5e98-4639-8c8d-93d7e27bd4b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:50:57.342511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: warnings.warn(msg) Aug 24 07:50:57.342511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: Aug 24 07:50:57.344073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca32d7-5e98-4639-8c8d-93d7e27bd4b9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.357298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 746/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:50:57.361513 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.363173 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:57.396921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896babcc-122e-4d8d-92c3-522831ae3450 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.491267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4c07-c901-4503-a3ec-8befcdf3301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.491957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4c07-c901-4503-a3ec-8befcdf3301f admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.492235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4c07-c901-4503-a3ec-8befcdf3301f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.492504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4c07-c901-4503-a3ec-8befcdf3301f admin admin] PATH_INFO: `/v3/projects/de9db05ac00e4c4c9ac2cdc5e8ae43ae/users/67599fcfb5984cf791b9005a8aa365e4/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.514671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4c07-c901-4503-a3ec-8befcdf3301f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9db05ac00e4c4c9ac2cdc5e8ae43ae, user_id=67599fcfb5984cf791b9005a8aa365e4, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.516222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WARNING py.warnings [None req-a3ca4c07-c901-4503-a3ec-8befcdf3301f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:50:57.516222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: warnings.warn(msg) Aug 24 07:50:57.516222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: Aug 24 07:50:57.518158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4c07-c901-4503-a3ec-8befcdf3301f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.607927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 755/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:50:57 2022] PUT /identity/v3/projects/de9db05ac00e4c4c9ac2cdc5e8ae43ae/users/67599fcfb5984cf791b9005a8aa365e4/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:50:57.620128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1753-c038-4bd5-b5ae-dac9343e586d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.620416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1753-c038-4bd5-b5ae-dac9343e586d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.620695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1753-c038-4bd5-b5ae-dac9343e586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.676380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8b0e1753-c038-4bd5-b5ae-dac9343e586d None None] MFA Rules not processed for user `67599fcfb5984cf791b9005a8aa365e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:57.677588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8b0e1753-c038-4bd5-b5ae-dac9343e586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:57.756127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 747/1502] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:50:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:57.769752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e3303-9427-46b4-a4e6-19d9a6c85046 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.770036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e3303-9427-46b4-a4e6-19d9a6c85046 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.770312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e3303-9427-46b4-a4e6-19d9a6c85046 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.771724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 756/1503] 10.222.0.17 () {54 vars in 964 bytes} [Wed Aug 24 07:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:57.776486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567f409-d81f-4a72-9846-3f95901d05bf None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.776775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567f409-d81f-4a72-9846-3f95901d05bf None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.777047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567f409-d81f-4a72-9846-3f95901d05bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.807294 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.853503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f567f409-d81f-4a72-9846-3f95901d05bf None None] MFA Rules not processed for user `a3de64d734a04f9e9ab0d85e5c985e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:57.854711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f567f409-d81f-4a72-9846-3f95901d05bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:57.928431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 748/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Aug 24 07:50:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:50:57.936346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e3303-9427-46b4-a4e6-19d9a6c85046 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.938472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7c9e3303-9427-46b4-a4e6-19d9a6c85046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:57.988729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:58.042641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e3303-9427-46b4-a4e6-19d9a6c85046 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.116585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.117206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.117467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.117735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.119355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:58.338817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:58.340218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:58.345552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:58.360982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 757/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:50:58.408711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41197fcd-40f7-4ec4-a228-ba5b592dc970 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.409149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41197fcd-40f7-4ec4-a228-ba5b592dc970 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.409242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41197fcd-40f7-4ec4-a228-ba5b592dc970 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.410485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 749/1506] 10.222.0.17 () {52 vars in 830 bytes} [Wed Aug 24 07:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:58.414170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.415409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:58.511552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f6b8f-77cf-4042-856a-fd112336f64c service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.603185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.603774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.604059 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.604335 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] PATH_INFO: `/v3/users/67599fcfb5984cf791b9005a8aa365e4` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.616852 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67599fcfb5984cf791b9005a8aa365e4)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:58.617913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WARNING py.warnings [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:50:58.617913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: warnings.warn(msg) Aug 24 07:50:58.617913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: Aug 24 07:50:58.619115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:58.629235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:58.850560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67599fcfb5984cf791b9005a8aa365e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:50:58.851009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67599fcfb5984cf791b9005a8aa365e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:50:58.851620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67599fcfb5984cf791b9005a8aa365e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:50:58.875836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67599fcfb5984cf791b9005a8aa365e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:50:58.938404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67599fcfb5984cf791b9005a8aa365e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:50:58.958358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 758/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:50:58 2022] DELETE /identity/v3/users/67599fcfb5984cf791b9005a8aa365e4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:58.962707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632b86-8a7a-405a-b7bf-611d0e512bb3 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.962997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632b86-8a7a-405a-b7bf-611d0e512bb3 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.963278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632b86-8a7a-405a-b7bf-611d0e512bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:59.021169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-a0632b86-8a7a-405a-b7bf-611d0e512bb3 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:59.022370 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a0632b86-8a7a-405a-b7bf-611d0e512bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:59.099228 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:59.112178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 750/1508] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:50:59.121829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:59.123100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:59.224438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6e071-c900-41fd-80fc-aa2b57cfb634 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:59.277855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:59.297411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea076d-2a9d-42b8-815a-a526e192918a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:59.298060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea076d-2a9d-42b8-815a-a526e192918a service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:59.298337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea076d-2a9d-42b8-815a-a526e192918a service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:59.298608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea076d-2a9d-42b8-815a-a526e192918a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:59.300220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-01ea076d-2a9d-42b8-815a-a526e192918a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:59.411434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea076d-2a9d-42b8-815a-a526e192918a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:59.412898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea076d-2a9d-42b8-815a-a526e192918a service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:59.431427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 759/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:50:59.893472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632b86-8a7a-405a-b7bf-611d0e512bb3 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:59.894811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a0632b86-8a7a-405a-b7bf-611d0e512bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:59.906192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632b86-8a7a-405a-b7bf-611d0e512bb3 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:00.004171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:00.004797 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.005073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.005342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] PATH_INFO: `/v3/projects/de9db05ac00e4c4c9ac2cdc5e8ae43ae` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.015097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9db05ac00e4c4c9ac2cdc5e8ae43ae)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:00.016225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WARNING py.warnings [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:51:00.016225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: warnings.warn(msg) Aug 24 07:51:00.016225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: Aug 24 07:51:00.017339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:00.127504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9db05ac00e4c4c9ac2cdc5e8ae43ae', 'request_id': 'req-0b217bb6-567b-486b-b96b-6cace7a46e42'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:51:00.141054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9db05ac00e4c4c9ac2cdc5e8ae43ae', 'request_id': 'req-0b217bb6-567b-486b-b96b-6cace7a46e42'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:51:00.205691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9db05ac00e4c4c9ac2cdc5e8ae43ae', 'request_id': 'req-0b217bb6-567b-486b-b96b-6cace7a46e42'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:51:00.229234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] The token cache is being invalidate because project de9db05ac00e4c4c9ac2cdc5e8ae43ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:51:00.229515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:51:00.230034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0b217bb6-567b-486b-b96b-6cace7a46e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:51:00.231361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 751/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:50:59 2022] DELETE /identity/v3/projects/de9db05ac00e4c4c9ac2cdc5e8ae43ae => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:51:09.429131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=62 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:10.227358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:36.731410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fb5c8-b9ce-4363-95c1-92652d49a511 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:36.731974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fb5c8-b9ce-4363-95c1-92652d49a511 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:36.731974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fb5c8-b9ce-4363-95c1-92652d49a511 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:36.733287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:36.738289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1026-61f8-45a0-9eaf-92f0aa7e2450 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:36.738704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1026-61f8-45a0-9eaf-92f0aa7e2450 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:36.738833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1026-61f8-45a0-9eaf-92f0aa7e2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:36.822688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-756c1026-61f8-45a0-9eaf-92f0aa7e2450 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:36.824090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-756c1026-61f8-45a0-9eaf-92f0aa7e2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:36.926204 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:37.079602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fb5c8-b9ce-4363-95c1-92652d49a511 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:37.081698 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e36fb5c8-b9ce-4363-95c1-92652d49a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:37.199339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fb5c8-b9ce-4363-95c1-92652d49a511 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:37.204746 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd9067-7ebd-43a3-aaf5-22c63a7deb11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:37.205344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd9067-7ebd-43a3-aaf5-22c63a7deb11 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:37.205623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd9067-7ebd-43a3-aaf5-22c63a7deb11 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:37.205894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd9067-7ebd-43a3-aaf5-22c63a7deb11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:37.214228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd9067-7ebd-43a3-aaf5-22c63a7deb11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:37.215826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd9067-7ebd-43a3-aaf5-22c63a7deb11 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:37.224919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 761/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:38.061422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13f881-1039-4c34-b468-6d20ae486088 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.061953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13f881-1039-4c34-b468-6d20ae486088 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.061953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13f881-1039-4c34-b468-6d20ae486088 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:38.063269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:38.068289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e7e5-4b27-4e23-9354-48334a2e8973 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.068729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e7e5-4b27-4e23-9354-48334a2e8973 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.068837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e7e5-4b27-4e23-9354-48334a2e8973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:38.088580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-9569e7e5-4b27-4e23-9354-48334a2e8973 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:38.089899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9569e7e5-4b27-4e23-9354-48334a2e8973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:38.098022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:38.253849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13f881-1039-4c34-b468-6d20ae486088 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:38.268225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13f881-1039-4c34-b468-6d20ae486088 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:38.273549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185c050-8b03-45b1-bf56-d1d9045c2578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:38.274168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185c050-8b03-45b1-bf56-d1d9045c2578 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.274443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185c050-8b03-45b1-bf56-d1d9045c2578 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.274712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185c050-8b03-45b1-bf56-d1d9045c2578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:38.282847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185c050-8b03-45b1-bf56-d1d9045c2578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:38.284457 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185c050-8b03-45b1-bf56-d1d9045c2578 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:38.294396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 754/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:39.281371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cbb50-1c6b-4bdc-a4b4-6c4fe2245835 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:39.281957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cbb50-1c6b-4bdc-a4b4-6c4fe2245835 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:39.281957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cbb50-1c6b-4bdc-a4b4-6c4fe2245835 None None] PATH_INFO: `/v3` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:39.283235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 763/1517] 10.222.0.61 () {54 vars in 925 bytes} [Wed Aug 24 07:52:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:39.289553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3997f-e04a-419f-a461-7b6660ccf83d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:39.289973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3997f-e04a-419f-a461-7b6660ccf83d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:39.290127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3997f-e04a-419f-a461-7b6660ccf83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:39.349391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c3c3997f-e04a-419f-a461-7b6660ccf83d None None] MFA Rules not processed for user `36bd5aef3c034c41be036c4cc9eed376`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:39.350578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c3c3997f-e04a-419f-a461-7b6660ccf83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:39.367669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:39.425479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 755/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Wed Aug 24 07:52:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:52:43.444779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daea86-411b-4dba-8960-583aca39c48e None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:43.445332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daea86-411b-4dba-8960-583aca39c48e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:43.445332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daea86-411b-4dba-8960-583aca39c48e None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:43.446667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 764/1519] 10.222.0.17 () {54 vars in 961 bytes} [Wed Aug 24 07:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:43.451986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e583d-533f-46b6-873c-1156c81c5b04 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:43.452390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e583d-533f-46b6-873c-1156c81c5b04 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:43.452533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e583d-533f-46b6-873c-1156c81c5b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:43.472284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7a7e583d-533f-46b6-873c-1156c81c5b04 None None] MFA Rules not processed for user `36bd5aef3c034c41be036c4cc9eed376`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:43.473475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7a7e583d-533f-46b6-873c-1156c81c5b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:43.482978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 756/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Aug 24 07:52:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:43.490309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daea86-411b-4dba-8960-583aca39c48e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:43.503828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daea86-411b-4dba-8960-583aca39c48e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:43.508773 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73721f12-ac64-4d3a-bf91-04f2f90bd4d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:43.509360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73721f12-ac64-4d3a-bf91-04f2f90bd4d5 service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:43.509643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73721f12-ac64-4d3a-bf91-04f2f90bd4d5 service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:43.509916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73721f12-ac64-4d3a-bf91-04f2f90bd4d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:43.518087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73721f12-ac64-4d3a-bf91-04f2f90bd4d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:43.519708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73721f12-ac64-4d3a-bf91-04f2f90bd4d5 service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:43.529879 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 765/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:49.526433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26cfd4-2754-4f97-9984-ab772d365d43 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:49.527063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26cfd4-2754-4f97-9984-ab772d365d43 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:49.527063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26cfd4-2754-4f97-9984-ab772d365d43 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:49.529784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:49.534916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4f95-df64-44ba-81e4-2179581ef91b None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:49.535379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4f95-df64-44ba-81e4-2179581ef91b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:49.535519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4f95-df64-44ba-81e4-2179581ef91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:49.554381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-f3cf4f95-df64-44ba-81e4-2179581ef91b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:49.555597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f3cf4f95-df64-44ba-81e4-2179581ef91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:49.563960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:49.720410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26cfd4-2754-4f97-9984-ab772d365d43 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:49.735650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26cfd4-2754-4f97-9984-ab772d365d43 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:49.742578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0640e-0a46-48ea-97dd-79e706d7a3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:49.743170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0640e-0a46-48ea-97dd-79e706d7a3e9 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:49.743482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0640e-0a46-48ea-97dd-79e706d7a3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:49.743747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0640e-0a46-48ea-97dd-79e706d7a3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:49.755387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0640e-0a46-48ea-97dd-79e706d7a3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:49.765161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0640e-0a46-48ea-97dd-79e706d7a3e9 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:49.767217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 758/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:50.613508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fde969-9370-4904-8157-70618d990986 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:50.614020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fde969-9370-4904-8157-70618d990986 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:50.614020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fde969-9370-4904-8157-70618d990986 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:50.615468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:50.620199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a862-2c44-4cef-8e62-280ee209cb45 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:50.620626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a862-2c44-4cef-8e62-280ee209cb45 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:50.621417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9a862-2c44-4cef-8e62-280ee209cb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:50.641076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-70e9a862-2c44-4cef-8e62-280ee209cb45 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:50.642262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-70e9a862-2c44-4cef-8e62-280ee209cb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:50.650136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:50.807873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fde969-9370-4904-8157-70618d990986 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:50.822661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fde969-9370-4904-8157-70618d990986 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:50.828052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b5fb4-7ece-4ebd-b526-dc0062db4b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:50.828643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b5fb4-7ece-4ebd-b526-dc0062db4b38 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:50.828956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b5fb4-7ece-4ebd-b526-dc0062db4b38 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:50.829177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b5fb4-7ece-4ebd-b526-dc0062db4b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:50.837426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b5fb4-7ece-4ebd-b526-dc0062db4b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:50.839007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b5fb4-7ece-4ebd-b526-dc0062db4b38 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:50.848359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 768/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:54.696922 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809bb1e-b5e0-4592-ba7e-740eba75623b None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:54.697493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809bb1e-b5e0-4592-ba7e-740eba75623b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:54.697493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809bb1e-b5e0-4592-ba7e-740eba75623b None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:54.699035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:54.704186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6493dca-f69b-4d27-833f-38edd8cf02cf None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:54.704639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6493dca-f69b-4d27-833f-38edd8cf02cf None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:54.704737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6493dca-f69b-4d27-833f-38edd8cf02cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:54.725292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d6493dca-f69b-4d27-833f-38edd8cf02cf None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:54.726470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d6493dca-f69b-4d27-833f-38edd8cf02cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:54.735180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:52:55.029796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809bb1e-b5e0-4592-ba7e-740eba75623b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:55.031754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a809bb1e-b5e0-4592-ba7e-740eba75623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:55.114585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809bb1e-b5e0-4592-ba7e-740eba75623b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:55.118200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b145b7d-1f4e-4b34-975f-10eceb5c9a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:55.119694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b145b7d-1f4e-4b34-975f-10eceb5c9a83 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:55.120305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b145b7d-1f4e-4b34-975f-10eceb5c9a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:55.120594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b145b7d-1f4e-4b34-975f-10eceb5c9a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:55.129619 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b145b7d-1f4e-4b34-975f-10eceb5c9a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:55.131038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b145b7d-1f4e-4b34-975f-10eceb5c9a83 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:55.141179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 761/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:52:57.053270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b3dc9-4cf3-45ad-8b8d-2b58e127b6ac None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:57.053792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b3dc9-4cf3-45ad-8b8d-2b58e127b6ac None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:57.053930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b3dc9-4cf3-45ad-8b8d-2b58e127b6ac None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:57.055178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:57.060567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d84650-cb48-490d-a418-68267d703e1f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:57.060978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d84650-cb48-490d-a418-68267d703e1f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:57.061120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d84650-cb48-490d-a418-68267d703e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:57.081175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c1d84650-cb48-490d-a418-68267d703e1f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:57.082311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c1d84650-cb48-490d-a418-68267d703e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:57.091282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:52:57.389906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b3dc9-4cf3-45ad-8b8d-2b58e127b6ac None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:57.400677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b3dc9-4cf3-45ad-8b8d-2b58e127b6ac None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:57.405333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82b53c-3f41-49fd-a785-2699c5a6c9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:57.405931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82b53c-3f41-49fd-a785-2699c5a6c9cf service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:57.406206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82b53c-3f41-49fd-a785-2699c5a6c9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:57.406473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82b53c-3f41-49fd-a785-2699c5a6c9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:57.415182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82b53c-3f41-49fd-a785-2699c5a6c9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:57.416641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82b53c-3f41-49fd-a785-2699c5a6c9cf service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:57.426300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 771/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:53:00.829643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92a7b9-9731-4385-a7bd-2334de1298b9 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:00.830284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92a7b9-9731-4385-a7bd-2334de1298b9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:00.830284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92a7b9-9731-4385-a7bd-2334de1298b9 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:00.831793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:53:00.836873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370bcef-fe1e-4a8a-b18c-83284bf51b96 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:00.837283 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370bcef-fe1e-4a8a-b18c-83284bf51b96 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:00.837424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370bcef-fe1e-4a8a-b18c-83284bf51b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:00.845174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=81 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:00.856990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-9370bcef-fe1e-4a8a-b18c-83284bf51b96 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:00.864075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9370bcef-fe1e-4a8a-b18c-83284bf51b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:00.866089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:53:01.426012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92a7b9-9731-4385-a7bd-2334de1298b9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:01.427768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3f92a7b9-9731-4385-a7bd-2334de1298b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:01.494245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:01.508112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92a7b9-9731-4385-a7bd-2334de1298b9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:01.512346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763ac69-dc38-45b4-aa76-8984bb13162b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:01.512964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ac69-dc38-45b4-aa76-8984bb13162b service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:01.513253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ac69-dc38-45b4-aa76-8984bb13162b service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:01.513518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763ac69-dc38-45b4-aa76-8984bb13162b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:01.522319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763ac69-dc38-45b4-aa76-8984bb13162b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:01.523812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763ac69-dc38-45b4-aa76-8984bb13162b service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:01.532923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 764/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:53:03.472314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea7324-ee55-4a5a-81ab-bd58bd793d9d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:03.472911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea7324-ee55-4a5a-81ab-bd58bd793d9d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:03.472911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea7324-ee55-4a5a-81ab-bd58bd793d9d None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:03.474230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:53:03.479515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691a4b-3293-49f3-a51a-e072b183eff4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:03.480697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691a4b-3293-49f3-a51a-e072b183eff4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:03.481265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691a4b-3293-49f3-a51a-e072b183eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:03.502711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-bf691a4b-3293-49f3-a51a-e072b183eff4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:03.503973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bf691a4b-3293-49f3-a51a-e072b183eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:03.512163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:53:04.063198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea7324-ee55-4a5a-81ab-bd58bd793d9d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:04.065268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-74ea7324-ee55-4a5a-81ab-bd58bd793d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:04.079189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea7324-ee55-4a5a-81ab-bd58bd793d9d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:04.082682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c771600-8704-4e66-9b2d-ab6902db826a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:04.083274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c771600-8704-4e66-9b2d-ab6902db826a service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:04.083580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c771600-8704-4e66-9b2d-ab6902db826a service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:04.083849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c771600-8704-4e66-9b2d-ab6902db826a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:04.093970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c771600-8704-4e66-9b2d-ab6902db826a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:04.095480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c771600-8704-4e66-9b2d-ab6902db826a service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:04.105376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 774/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:53:13.497107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=11 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:14.100702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=8 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:36.985101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e823e4-6950-4d0a-835a-fe5b925f08b3 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:36.987952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e823e4-6950-4d0a-835a-fe5b925f08b3 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:36.987952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e823e4-6950-4d0a-835a-fe5b925f08b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.013454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e1e823e4-6950-4d0a-835a-fe5b925f08b3 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.014761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e1e823e4-6950-4d0a-835a-fe5b925f08b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.028112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 766/1540] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.036498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be345b8-45ec-4683-bc75-387fa81a73d5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.037103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be345b8-45ec-4683-bc75-387fa81a73d5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.037103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be345b8-45ec-4683-bc75-387fa81a73d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.069465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed75e2-527c-4f10-aaf4-b8355a7828d2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.069836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed75e2-527c-4f10-aaf4-b8355a7828d2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.070034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed75e2-527c-4f10-aaf4-b8355a7828d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.071819 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-4be345b8-45ec-4683-bc75-387fa81a73d5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.073034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4be345b8-45ec-4683-bc75-387fa81a73d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.094317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 775/1541] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.100344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be345b8-45ec-4683-bc75-387fa81a73d5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.111195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-18ed75e2-527c-4f10-aaf4-b8355a7828d2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.112464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-18ed75e2-527c-4f10-aaf4-b8355a7828d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.128906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 767/1542] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:54:37.130380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be345b8-45ec-4683-bc75-387fa81a73d5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.136061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219a704-84f8-4823-be8c-6e4f289e84ab None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.136358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219a704-84f8-4823-be8c-6e4f289e84ab None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.136635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219a704-84f8-4823-be8c-6e4f289e84ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.140128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff14f9-3aad-45e1-b77b-351195c6e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.140747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff14f9-3aad-45e1-b77b-351195c6e13f admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.141025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff14f9-3aad-45e1-b77b-351195c6e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.141345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff14f9-3aad-45e1-b77b-351195c6e13f admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.142563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff14f9-3aad-45e1-b77b-351195c6e13f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:37.142867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff14f9-3aad-45e1-b77b-351195c6e13f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.144056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WARNING py.warnings [None req-e7ff14f9-3aad-45e1-b77b-351195c6e13f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:54:37.144056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: warnings.warn(msg) Aug 24 07:54:37.144056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: Aug 24 07:54:37.144940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff14f9-3aad-45e1-b77b-351195c6e13f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.172453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 776/1543] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:37.173615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-6219a704-84f8-4823-be8c-6e4f289e84ab None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.173868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dbd5a-67d3-4e72-b93e-e3cadc689fcf None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.174160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dbd5a-67d3-4e72-b93e-e3cadc689fcf None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.174450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dbd5a-67d3-4e72-b93e-e3cadc689fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.174837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6219a704-84f8-4823-be8c-6e4f289e84ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.190944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 768/1544] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:54:37.193311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b389-7e20-4508-accd-352f345edb43 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.193602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b389-7e20-4508-accd-352f345edb43 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.193884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b389-7e20-4508-accd-352f345edb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.218707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-5d0dbd5a-67d3-4e72-b93e-e3cadc689fcf None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.220056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5d0dbd5a-67d3-4e72-b93e-e3cadc689fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.230202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e6a4b389-7e20-4508-accd-352f345edb43 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.232472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e6a4b389-7e20-4508-accd-352f345edb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.238467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 777/1545] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.240338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dbd5a-67d3-4e72-b93e-e3cadc689fcf None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.254586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 769/1546] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.256491 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c67935-0674-4198-9c1e-6f64c9fc4d0e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.256773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c67935-0674-4198-9c1e-6f64c9fc4d0e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.257042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c67935-0674-4198-9c1e-6f64c9fc4d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.257748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dbd5a-67d3-4e72-b93e-e3cadc689fcf None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.275469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba6b35-4f8d-4ccf-b2a9-b08e4ae05bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.276106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba6b35-4f8d-4ccf-b2a9-b08e4ae05bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.276386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba6b35-4f8d-4ccf-b2a9-b08e4ae05bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.276657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba6b35-4f8d-4ccf-b2a9-b08e4ae05bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.277549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba6b35-4f8d-4ccf-b2a9-b08e4ae05bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.279515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba6b35-4f8d-4ccf-b2a9-b08e4ae05bc9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.294033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e4c67935-0674-4198-9c1e-6f64c9fc4d0e None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.295831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e4c67935-0674-4198-9c1e-6f64c9fc4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.311333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 770/1547] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.311333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ab49f-427a-4887-a326-aece69bf8fb4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.311333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ab49f-427a-4887-a326-aece69bf8fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.311333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ab49f-427a-4887-a326-aece69bf8fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.330948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-985ab49f-427a-4887-a326-aece69bf8fb4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.332400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-985ab49f-427a-4887-a326-aece69bf8fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.344922 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 771/1548] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.350485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ab49f-427a-4887-a326-aece69bf8fb4 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.355962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ab49f-427a-4887-a326-aece69bf8fb4 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.360663 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a03c09-56f3-4994-ab88-4d404cc5b9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.361295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a03c09-56f3-4994-ab88-4d404cc5b9ab admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.361578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a03c09-56f3-4994-ab88-4d404cc5b9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.361849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a03c09-56f3-4994-ab88-4d404cc5b9ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.362493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a03c09-56f3-4994-ab88-4d404cc5b9ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:37.362796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a03c09-56f3-4994-ab88-4d404cc5b9ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.364413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a03c09-56f3-4994-ab88-4d404cc5b9ab admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.377502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 772/1549] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:37.378735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816fb5-4d1d-4f34-ad7f-653a386bb225 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.379023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816fb5-4d1d-4f34-ad7f-653a386bb225 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.379340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816fb5-4d1d-4f34-ad7f-653a386bb225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.396636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 778/1550] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:37.397448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ba5fe-2b86-4735-b15e-2d62eb66b5b6 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.397803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ba5fe-2b86-4735-b15e-2d62eb66b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.398189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ba5fe-2b86-4735-b15e-2d62eb66b5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.400156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e0816fb5-4d1d-4f34-ad7f-653a386bb225 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.401478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e0816fb5-4d1d-4f34-ad7f-653a386bb225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.417875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-aa9ba5fe-2b86-4735-b15e-2d62eb66b5b6 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.419063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-aa9ba5fe-2b86-4735-b15e-2d62eb66b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.466793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 773/1551] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.468096 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675a39-5099-4bf7-9ecc-9799fc3cd755 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.468416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675a39-5099-4bf7-9ecc-9799fc3cd755 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.468671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675a39-5099-4bf7-9ecc-9799fc3cd755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.484082 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 779/1552] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.485277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ba5fe-2b86-4735-b15e-2d62eb66b5b6 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.494435 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-4b675a39-5099-4bf7-9ecc-9799fc3cd755 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.495697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4b675a39-5099-4bf7-9ecc-9799fc3cd755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.495978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ba5fe-2b86-4735-b15e-2d62eb66b5b6 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.500591 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5017ed-7e6a-4ba6-940e-5ff175fdbba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.501198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5017ed-7e6a-4ba6-940e-5ff175fdbba3 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.501479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5017ed-7e6a-4ba6-940e-5ff175fdbba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.501754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5017ed-7e6a-4ba6-940e-5ff175fdbba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.502440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5017ed-7e6a-4ba6-940e-5ff175fdbba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:37.502742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5017ed-7e6a-4ba6-940e-5ff175fdbba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.504004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 774/1553] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.505845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5017ed-7e6a-4ba6-940e-5ff175fdbba3 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.505962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa668d7-326e-43e2-8e40-cf19e3006ecf None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.505962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa668d7-326e-43e2-8e40-cf19e3006ecf None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.505962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa668d7-326e-43e2-8e40-cf19e3006ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.521360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 780/1554] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:37.522479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd55c3-ac57-475c-8fc4-9675ccf5f332 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.522769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd55c3-ac57-475c-8fc4-9675ccf5f332 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.523040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd55c3-ac57-475c-8fc4-9675ccf5f332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.528686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1aa668d7-326e-43e2-8e40-cf19e3006ecf None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.534359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1aa668d7-326e-43e2-8e40-cf19e3006ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.538396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 775/1555] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.539798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa668d7-326e-43e2-8e40-cf19e3006ecf None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.544243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-11fd55c3-ac57-475c-8fc4-9675ccf5f332 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.545547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-11fd55c3-ac57-475c-8fc4-9675ccf5f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.549786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa668d7-326e-43e2-8e40-cf19e3006ecf None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.553523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 781/1556] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.553523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd55c3-ac57-475c-8fc4-9675ccf5f332 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.558631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47da3d-0642-4c76-8093-f87cefd902ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.559237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47da3d-0642-4c76-8093-f87cefd902ac admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.559553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47da3d-0642-4c76-8093-f87cefd902ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.559844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47da3d-0642-4c76-8093-f87cefd902ac admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.560467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47da3d-0642-4c76-8093-f87cefd902ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.561483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WARNING py.warnings [None req-3f47da3d-0642-4c76-8093-f87cefd902ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:54:37.561483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: warnings.warn(msg) Aug 24 07:54:37.561483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: Aug 24 07:54:37.562674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47da3d-0642-4c76-8093-f87cefd902ac admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.565152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd55c3-ac57-475c-8fc4-9675ccf5f332 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.569698 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e8915-a1d8-40d6-95fd-ba990cdca1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.570291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8915-a1d8-40d6-95fd-ba990cdca1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.570597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8915-a1d8-40d6-95fd-ba990cdca1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.573879 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8915-a1d8-40d6-95fd-ba990cdca1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.574526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e8915-a1d8-40d6-95fd-ba990cdca1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.575610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WARNING py.warnings [None req-8c2e8915-a1d8-40d6-95fd-ba990cdca1c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:54:37.575610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: warnings.warn(msg) Aug 24 07:54:37.575610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: Aug 24 07:54:37.576806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e8915-a1d8-40d6-95fd-ba990cdca1c3 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.652638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 776/1557] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:37.653851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72f3b4-3dc9-44a9-b5d6-1e10fdfae74e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.654159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72f3b4-3dc9-44a9-b5d6-1e10fdfae74e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.654437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72f3b4-3dc9-44a9-b5d6-1e10fdfae74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.672075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 782/1558] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:37.672075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e8915-a1d8-40d6-95fd-ba990cdca1c3 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.676522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7a72f3b4-3dc9-44a9-b5d6-1e10fdfae74e None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.677747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7a72f3b4-3dc9-44a9-b5d6-1e10fdfae74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.680558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e8915-a1d8-40d6-95fd-ba990cdca1c3 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.743692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 777/1559] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.744123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76d40e-392a-45e5-99eb-2dfe7c3c0183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.744846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76d40e-392a-45e5-99eb-2dfe7c3c0183 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.744986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866e85-c649-4794-8cb9-f4553b7d46eb None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.745162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76d40e-392a-45e5-99eb-2dfe7c3c0183 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.745367 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866e85-c649-4794-8cb9-f4553b7d46eb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.745529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866e85-c649-4794-8cb9-f4553b7d46eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.745645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76d40e-392a-45e5-99eb-2dfe7c3c0183 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.746412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76d40e-392a-45e5-99eb-2dfe7c3c0183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:37.746720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76d40e-392a-45e5-99eb-2dfe7c3c0183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.748463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76d40e-392a-45e5-99eb-2dfe7c3c0183 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.757967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:37.761760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 783/1560] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:37.762623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76d40e-392a-45e5-99eb-2dfe7c3c0183 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.764640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ee866e85-c649-4794-8cb9-f4553b7d46eb None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.765833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ee866e85-c649-4794-8cb9-f4553b7d46eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.772432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76d40e-392a-45e5-99eb-2dfe7c3c0183 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.775790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 778/1561] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.775790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e22c-8348-4489-ae4f-8d6428f63c6b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.775790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e22c-8348-4489-ae4f-8d6428f63c6b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.775790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711e22c-8348-4489-ae4f-8d6428f63c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.781588 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770c456-2cd8-43e1-a5c2-a973e5d00355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.782220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770c456-2cd8-43e1-a5c2-a973e5d00355 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.782500 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770c456-2cd8-43e1-a5c2-a973e5d00355 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.782795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770c456-2cd8-43e1-a5c2-a973e5d00355 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.783457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770c456-2cd8-43e1-a5c2-a973e5d00355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.785421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770c456-2cd8-43e1-a5c2-a973e5d00355 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.792860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:37.798512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-4711e22c-8348-4489-ae4f-8d6428f63c6b None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:37.799817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4711e22c-8348-4489-ae4f-8d6428f63c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:37.808534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 779/1562] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:37.811606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e22c-8348-4489-ae4f-8d6428f63c6b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.819241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711e22c-8348-4489-ae4f-8d6428f63c6b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.824108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd71a4-e2ed-48d2-9780-f079e248e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.824682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd71a4-e2ed-48d2-9780-f079e248e0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.824944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd71a4-e2ed-48d2-9780-f079e248e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.825215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd71a4-e2ed-48d2-9780-f079e248e0b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.825849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd71a4-e2ed-48d2-9780-f079e248e0b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:37.826151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd71a4-e2ed-48d2-9780-f079e248e0b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.827831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd71a4-e2ed-48d2-9780-f079e248e0b9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.841387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 780/1563] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:37.843074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd71a4-e2ed-48d2-9780-f079e248e0b9 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.851043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd71a4-e2ed-48d2-9780-f079e248e0b9 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:37.856554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89ea1b-ed90-4cd5-ad11-0fdbf63e0c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:37.857140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89ea1b-ed90-4cd5-ad11-0fdbf63e0c11 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:37.857426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89ea1b-ed90-4cd5-ad11-0fdbf63e0c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:37.857705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89ea1b-ed90-4cd5-ad11-0fdbf63e0c11 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:37.858314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89ea1b-ed90-4cd5-ad11-0fdbf63e0c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:37.860256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89ea1b-ed90-4cd5-ad11-0fdbf63e0c11 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:37.933198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 784/1564] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:37.934001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770c456-2cd8-43e1-a5c2-a973e5d00355 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:37.996871 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770c456-2cd8-43e1-a5c2-a973e5d00355 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.001735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b097f8-7cce-4cc6-9655-29bb29249e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.003756 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b097f8-7cce-4cc6-9655-29bb29249e19 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.003756 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b097f8-7cce-4cc6-9655-29bb29249e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.003756 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b097f8-7cce-4cc6-9655-29bb29249e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.003756 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b097f8-7cce-4cc6-9655-29bb29249e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.005105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b097f8-7cce-4cc6-9655-29bb29249e19 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.014716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 785/1565] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:38.015534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b097f8-7cce-4cc6-9655-29bb29249e19 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.025586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b097f8-7cce-4cc6-9655-29bb29249e19 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.032443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b8a19-0d72-472a-bb23-ef9fbf7de603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.032443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b8a19-0d72-472a-bb23-ef9fbf7de603 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.032443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b8a19-0d72-472a-bb23-ef9fbf7de603 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.032443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b8a19-0d72-472a-bb23-ef9fbf7de603 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.032868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b8a19-0d72-472a-bb23-ef9fbf7de603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:38.032868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b8a19-0d72-472a-bb23-ef9fbf7de603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.033822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b8a19-0d72-472a-bb23-ef9fbf7de603 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.046474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 786/1566] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:38.047249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b8a19-0d72-472a-bb23-ef9fbf7de603 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.057049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b8a19-0d72-472a-bb23-ef9fbf7de603 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.061946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccb543-ecef-4797-b93c-fb91495b10e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.062543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccb543-ecef-4797-b93c-fb91495b10e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.062824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccb543-ecef-4797-b93c-fb91495b10e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.063099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccb543-ecef-4797-b93c-fb91495b10e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.063997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccb543-ecef-4797-b93c-fb91495b10e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.065895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccb543-ecef-4797-b93c-fb91495b10e1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.148977 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 781/1567] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:37 2022] POST /identity/v3/users => generated 295 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.150222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89ea1b-ed90-4cd5-ad11-0fdbf63e0c11 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.160612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89ea1b-ed90-4cd5-ad11-0fdbf63e0c11 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.166434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9119-cf91-44b9-8831-aa9126c97a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.167044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9119-cf91-44b9-8831-aa9126c97a3e admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.167364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9119-cf91-44b9-8831-aa9126c97a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.167639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc9119-cf91-44b9-8831-aa9126c97a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.168276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc9119-cf91-44b9-8831-aa9126c97a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:38.168578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc9119-cf91-44b9-8831-aa9126c97a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.170169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc9119-cf91-44b9-8831-aa9126c97a3e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.178033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 787/1568] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:38 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.181021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccb543-ecef-4797-b93c-fb91495b10e1 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.189596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 782/1569] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:38.189596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9119-cf91-44b9-8831-aa9126c97a3e admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.197608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc9119-cf91-44b9-8831-aa9126c97a3e admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.249556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccb543-ecef-4797-b93c-fb91495b10e1 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.252779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c65947-8f34-42fe-ad72-a32cf3ac0e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.253393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c65947-8f34-42fe-ad72-a32cf3ac0e41 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.253677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c65947-8f34-42fe-ad72-a32cf3ac0e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.253962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c65947-8f34-42fe-ad72-a32cf3ac0e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.254138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d71bb-c93c-41fc-a66a-337c0f62b8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.254709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c65947-8f34-42fe-ad72-a32cf3ac0e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.254806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d71bb-c93c-41fc-a66a-337c0f62b8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.255052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d71bb-c93c-41fc-a66a-337c0f62b8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.255351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d71bb-c93c-41fc-a66a-337c0f62b8c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.255997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d71bb-c93c-41fc-a66a-337c0f62b8c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:38.256296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d71bb-c93c-41fc-a66a-337c0f62b8c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.256776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c65947-8f34-42fe-ad72-a32cf3ac0e41 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.258355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d71bb-c93c-41fc-a66a-337c0f62b8c4 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.277949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 788/1570] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:38.277949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d71bb-c93c-41fc-a66a-337c0f62b8c4 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.287541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d71bb-c93c-41fc-a66a-337c0f62b8c4 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.292640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb600-0116-4dbb-b26c-8129b2a7eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.293222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb600-0116-4dbb-b26c-8129b2a7eb4f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.293498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb600-0116-4dbb-b26c-8129b2a7eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.293786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb600-0116-4dbb-b26c-8129b2a7eb4f admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.294407 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560eb600-0116-4dbb-b26c-8129b2a7eb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.296364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560eb600-0116-4dbb-b26c-8129b2a7eb4f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.349361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 783/1571] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:38 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.350343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c65947-8f34-42fe-ad72-a32cf3ac0e41 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.412501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c65947-8f34-42fe-ad72-a32cf3ac0e41 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.417541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929363d-2c6b-4d3f-b529-d630ea97fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.418139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929363d-2c6b-4d3f-b529-d630ea97fdfa admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.418419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929363d-2c6b-4d3f-b529-d630ea97fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.418703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929363d-2c6b-4d3f-b529-d630ea97fdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.419430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929363d-2c6b-4d3f-b529-d630ea97fdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.421039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929363d-2c6b-4d3f-b529-d630ea97fdfa admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.431186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 784/1572] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:38.432075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929363d-2c6b-4d3f-b529-d630ea97fdfa admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.437847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 789/1573] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:38 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.438876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb600-0116-4dbb-b26c-8129b2a7eb4f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.450313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929363d-2c6b-4d3f-b529-d630ea97fdfa admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.450502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb600-0116-4dbb-b26c-8129b2a7eb4f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.450616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d6c4c-e9e5-4bf7-8f36-942fc8419710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.450997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d6c4c-e9e5-4bf7-8f36-942fc8419710 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.451278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d6c4c-e9e5-4bf7-8f36-942fc8419710 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.451594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d6c4c-e9e5-4bf7-8f36-942fc8419710 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.452208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d6c4c-e9e5-4bf7-8f36-942fc8419710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.454014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cfe60-4f78-44e5-b6a2-c37b55cc281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.454147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d6c4c-e9e5-4bf7-8f36-942fc8419710 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.454604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cfe60-4f78-44e5-b6a2-c37b55cc281e admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.454881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cfe60-4f78-44e5-b6a2-c37b55cc281e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.455148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cfe60-4f78-44e5-b6a2-c37b55cc281e admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.455826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cfe60-4f78-44e5-b6a2-c37b55cc281e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.457384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cfe60-4f78-44e5-b6a2-c37b55cc281e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.468117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 790/1574] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:38.468901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cfe60-4f78-44e5-b6a2-c37b55cc281e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.477775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:38.481381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cfe60-4f78-44e5-b6a2-c37b55cc281e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.485870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadc6c6-9629-4278-baa1-7d358659a875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.486443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadc6c6-9629-4278-baa1-7d358659a875 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.486717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadc6c6-9629-4278-baa1-7d358659a875 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.486982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadc6c6-9629-4278-baa1-7d358659a875 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.487631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadc6c6-9629-4278-baa1-7d358659a875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.489612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadc6c6-9629-4278-baa1-7d358659a875 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.537941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 785/1575] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:38 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.538952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d6c4c-e9e5-4bf7-8f36-942fc8419710 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.556984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:38.589548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 791/1576] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:38 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.590361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadc6c6-9629-4278-baa1-7d358659a875 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.600370 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadc6c6-9629-4278-baa1-7d358659a875 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.601148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d6c4c-e9e5-4bf7-8f36-942fc8419710 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.605859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f987db2-43b9-41fd-8c83-b58b69aba669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.606122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ede8c-ee1c-4530-a733-74ae8f80b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.606454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f987db2-43b9-41fd-8c83-b58b69aba669 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.606736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f987db2-43b9-41fd-8c83-b58b69aba669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.606928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ede8c-ee1c-4530-a733-74ae8f80b428 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.607117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f987db2-43b9-41fd-8c83-b58b69aba669 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.607380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ede8c-ee1c-4530-a733-74ae8f80b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.607649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f987db2-43b9-41fd-8c83-b58b69aba669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.607782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ede8c-ee1c-4530-a733-74ae8f80b428 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.608461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ede8c-ee1c-4530-a733-74ae8f80b428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.609626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f987db2-43b9-41fd-8c83-b58b69aba669 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.610532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ede8c-ee1c-4530-a733-74ae8f80b428 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.714712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 786/1577] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:38 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.715763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ede8c-ee1c-4530-a733-74ae8f80b428 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.749529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 792/1578] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:38 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.750706 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f987db2-43b9-41fd-8c83-b58b69aba669 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.788283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ede8c-ee1c-4530-a733-74ae8f80b428 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.814787 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f987db2-43b9-41fd-8c83-b58b69aba669 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.819473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297ac86-0607-45ef-8315-aa4721fe8666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.820118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297ac86-0607-45ef-8315-aa4721fe8666 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.821167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297ac86-0607-45ef-8315-aa4721fe8666 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.821310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297ac86-0607-45ef-8315-aa4721fe8666 admin admin] PATH_INFO: `/v3/projects/358956167fd64083ac8ebbae682abe1a/users/ab5a74275a094eaf824f314402b00149/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.835989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297ac86-0607-45ef-8315-aa4721fe8666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358956167fd64083ac8ebbae682abe1a, user_id=ab5a74275a094eaf824f314402b00149, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.838910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297ac86-0607-45ef-8315-aa4721fe8666 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.846972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1707-4042-4e95-a4f8-c1156059f4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.847627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1707-4042-4e95-a4f8-c1156059f4ed admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.847926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1707-4042-4e95-a4f8-c1156059f4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.848185 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1707-4042-4e95-a4f8-c1156059f4ed admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.850201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1707-4042-4e95-a4f8-c1156059f4ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.850864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1707-4042-4e95-a4f8-c1156059f4ed admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.902686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 793/1579] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:38 2022] PUT /identity/v3/projects/358956167fd64083ac8ebbae682abe1a/users/ab5a74275a094eaf824f314402b00149/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:38.906699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297ac86-0607-45ef-8315-aa4721fe8666 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.931970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 787/1580] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:38 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.933030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1707-4042-4e95-a4f8-c1156059f4ed admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.943548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1707-4042-4e95-a4f8-c1156059f4ed admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.964681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297ac86-0607-45ef-8315-aa4721fe8666 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.969368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdae70f-8557-466d-9bab-8545f5186c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.969931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdae70f-8557-466d-9bab-8545f5186c87 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.970211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdae70f-8557-466d-9bab-8545f5186c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:38.970478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdae70f-8557-466d-9bab-8545f5186c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:38.971120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdae70f-8557-466d-9bab-8545f5186c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:38.972738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdae70f-8557-466d-9bab-8545f5186c87 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:38.980918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:38.983182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 794/1581] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:38.984113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdae70f-8557-466d-9bab-8545f5186c87 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:38.994233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdae70f-8557-466d-9bab-8545f5186c87 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:38.998873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee070382-7639-4862-b0e0-84a0323c1d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:38.999540 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee070382-7639-4862-b0e0-84a0323c1d94 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:38.999771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee070382-7639-4862-b0e0-84a0323c1d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.000043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee070382-7639-4862-b0e0-84a0323c1d94 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.000648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee070382-7639-4862-b0e0-84a0323c1d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.002530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee070382-7639-4862-b0e0-84a0323c1d94 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.009291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50ef53-9e78-4ab4-99d7-d0f250ca517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.009932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50ef53-9e78-4ab4-99d7-d0f250ca517d admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.010340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50ef53-9e78-4ab4-99d7-d0f250ca517d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.010617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50ef53-9e78-4ab4-99d7-d0f250ca517d admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.011328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50ef53-9e78-4ab4-99d7-d0f250ca517d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.012912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50ef53-9e78-4ab4-99d7-d0f250ca517d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.022865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 788/1582] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.023709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50ef53-9e78-4ab4-99d7-d0f250ca517d admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.033066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50ef53-9e78-4ab4-99d7-d0f250ca517d admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.038121 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777733b4-7261-4cba-b3a7-29401cc99dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.038689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777733b4-7261-4cba-b3a7-29401cc99dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.038973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777733b4-7261-4cba-b3a7-29401cc99dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.039802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777733b4-7261-4cba-b3a7-29401cc99dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.040422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777733b4-7261-4cba-b3a7-29401cc99dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.041963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777733b4-7261-4cba-b3a7-29401cc99dc7 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.051533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 789/1583] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.052276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777733b4-7261-4cba-b3a7-29401cc99dc7 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.062379 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777733b4-7261-4cba-b3a7-29401cc99dc7 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.067282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8433e4-763d-4e4a-bde9-621e53503187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.072299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8433e4-763d-4e4a-bde9-621e53503187 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.072299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8433e4-763d-4e4a-bde9-621e53503187 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.072299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8433e4-763d-4e4a-bde9-621e53503187 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.072299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8433e4-763d-4e4a-bde9-621e53503187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.072299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8433e4-763d-4e4a-bde9-621e53503187 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.097332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 795/1584] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:38 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:39.098145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee070382-7639-4862-b0e0-84a0323c1d94 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.108064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee070382-7639-4862-b0e0-84a0323c1d94 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.112674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9751d6-dcf8-4a17-89b3-b291505770b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.113240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9751d6-dcf8-4a17-89b3-b291505770b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.113515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9751d6-dcf8-4a17-89b3-b291505770b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.113785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9751d6-dcf8-4a17-89b3-b291505770b6 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.114381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9751d6-dcf8-4a17-89b3-b291505770b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.116317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9751d6-dcf8-4a17-89b3-b291505770b6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.154489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 790/1585] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:39 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:39.155745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430a468-a0eb-4cea-9f4b-c5065361c8d9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.156026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430a468-a0eb-4cea-9f4b-c5065361c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.156295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430a468-a0eb-4cea-9f4b-c5065361c8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.184592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-6430a468-a0eb-4cea-9f4b-c5065361c8d9 None None] MFA Rules not processed for user `ab5a74275a094eaf824f314402b00149`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:39.185891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6430a468-a0eb-4cea-9f4b-c5065361c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:39.194776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 796/1586] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:39 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:39.195967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9751d6-dcf8-4a17-89b3-b291505770b6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.205688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9751d6-dcf8-4a17-89b3-b291505770b6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.211171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd53dc-c0cf-465c-88c2-35c4b6d87a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.212834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd53dc-c0cf-465c-88c2-35c4b6d87a31 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.212834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd53dc-c0cf-465c-88c2-35c4b6d87a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.212834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd53dc-c0cf-465c-88c2-35c4b6d87a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.213162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd53dc-c0cf-465c-88c2-35c4b6d87a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.214777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd53dc-c0cf-465c-88c2-35c4b6d87a31 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.217057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:39.225719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 797/1587] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.226549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd53dc-c0cf-465c-88c2-35c4b6d87a31 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.239334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd53dc-c0cf-465c-88c2-35c4b6d87a31 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.248311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b855a-4b6d-40fd-b9a5-22f9c66a5bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.248931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b855a-4b6d-40fd-b9a5-22f9c66a5bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.249213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b855a-4b6d-40fd-b9a5-22f9c66a5bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.249484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b855a-4b6d-40fd-b9a5-22f9c66a5bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.250374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b855a-4b6d-40fd-b9a5-22f9c66a5bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.252080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b855a-4b6d-40fd-b9a5-22f9c66a5bf3 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.261005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 791/1588] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:39.262860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 798/1589] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.264111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b855a-4b6d-40fd-b9a5-22f9c66a5bf3 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.264543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430a468-a0eb-4cea-9f4b-c5065361c8d9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.275385 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b855a-4b6d-40fd-b9a5-22f9c66a5bf3 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.275972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430a468-a0eb-4cea-9f4b-c5065361c8d9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.280186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d076be1-70a1-4e0c-b076-6fb12705bcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.280534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b3e1-8063-4f03-8adf-233e95f868e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.280907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d076be1-70a1-4e0c-b076-6fb12705bcad admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.281183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b3e1-8063-4f03-8adf-233e95f868e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.281299 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d076be1-70a1-4e0c-b076-6fb12705bcad admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.281443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d076be1-70a1-4e0c-b076-6fb12705bcad admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.281547 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b3e1-8063-4f03-8adf-233e95f868e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.281727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b3e1-8063-4f03-8adf-233e95f868e0 admin admin] PATH_INFO: `/v3/projects/1302fb4e97364c39bf2e177836ffc3c7/users/e618ac2e8e884988b42a1d8b195eb457/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.282078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d076be1-70a1-4e0c-b076-6fb12705bcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.283898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d076be1-70a1-4e0c-b076-6fb12705bcad admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.295201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 799/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.296096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d076be1-70a1-4e0c-b076-6fb12705bcad admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.301985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3b3e1-8063-4f03-8adf-233e95f868e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1302fb4e97364c39bf2e177836ffc3c7, user_id=e618ac2e8e884988b42a1d8b195eb457, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.301985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WARNING py.warnings [None req-60e3b3e1-8063-4f03-8adf-233e95f868e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:54:39.301985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: warnings.warn(msg) Aug 24 07:54:39.301985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: Aug 24 07:54:39.301985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3b3e1-8063-4f03-8adf-233e95f868e0 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.307652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d076be1-70a1-4e0c-b076-6fb12705bcad admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.312671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5f128-cc90-43d9-a836-b721681db654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.313511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5f128-cc90-43d9-a836-b721681db654 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.313794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5f128-cc90-43d9-a836-b721681db654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.314064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5f128-cc90-43d9-a836-b721681db654 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.314702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5f128-cc90-43d9-a836-b721681db654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.316342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5f128-cc90-43d9-a836-b721681db654 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.326298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 800/1591] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.327065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5f128-cc90-43d9-a836-b721681db654 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.337271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5f128-cc90-43d9-a836-b721681db654 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.342096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8507531-8f18-48d1-acdc-37b33541cef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.342693 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8507531-8f18-48d1-acdc-37b33541cef8 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.343034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8507531-8f18-48d1-acdc-37b33541cef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.343317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8507531-8f18-48d1-acdc-37b33541cef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.343964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8507531-8f18-48d1-acdc-37b33541cef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.345526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8507531-8f18-48d1-acdc-37b33541cef8 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.357955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 801/1592] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.358656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8507531-8f18-48d1-acdc-37b33541cef8 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.368745 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8507531-8f18-48d1-acdc-37b33541cef8 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.373701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1adad5-4271-4b2f-bd43-26a879d1b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.374285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adad5-4271-4b2f-bd43-26a879d1b521 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.374594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adad5-4271-4b2f-bd43-26a879d1b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.374874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1adad5-4271-4b2f-bd43-26a879d1b521 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.375547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1adad5-4271-4b2f-bd43-26a879d1b521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.377144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1adad5-4271-4b2f-bd43-26a879d1b521 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.377317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 792/1593] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:39 2022] PUT /identity/v3/projects/1302fb4e97364c39bf2e177836ffc3c7/users/e618ac2e8e884988b42a1d8b195eb457/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:39.378136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b3e1-8063-4f03-8adf-233e95f868e0 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.388147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 802/1594] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.388551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1adad5-4271-4b2f-bd43-26a879d1b521 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.401236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1adad5-4271-4b2f-bd43-26a879d1b521 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.444982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b3e1-8063-4f03-8adf-233e95f868e0 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.449836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12f80-4725-4944-9963-dd859fb62f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.450445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12f80-4725-4944-9963-dd859fb62f96 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.450739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12f80-4725-4944-9963-dd859fb62f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.451011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12f80-4725-4944-9963-dd859fb62f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.451725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe12f80-4725-4944-9963-dd859fb62f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.453326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe12f80-4725-4944-9963-dd859fb62f96 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.457402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6208b1-3370-4d4b-b095-cdb93e513110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.458016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6208b1-3370-4d4b-b095-cdb93e513110 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.458325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6208b1-3370-4d4b-b095-cdb93e513110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.458600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6208b1-3370-4d4b-b095-cdb93e513110 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.459219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6208b1-3370-4d4b-b095-cdb93e513110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.461690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6208b1-3370-4d4b-b095-cdb93e513110 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.464027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 793/1595] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.467415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12f80-4725-4944-9963-dd859fb62f96 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.474334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12f80-4725-4944-9963-dd859fb62f96 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.480824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974da9-bc64-43fc-ba5b-dc839e9249ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.481417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974da9-bc64-43fc-ba5b-dc839e9249ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.481697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974da9-bc64-43fc-ba5b-dc839e9249ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.481977 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974da9-bc64-43fc-ba5b-dc839e9249ed admin admin] PATH_INFO: `/v3/projects/0e0a106dc6294aa889940838bd57c92c/users/0aaf0941153a421ca401cf398e8042ff/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.484439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:39.497468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974da9-bc64-43fc-ba5b-dc839e9249ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0a106dc6294aa889940838bd57c92c, user_id=0aaf0941153a421ca401cf398e8042ff, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.500171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974da9-bc64-43fc-ba5b-dc839e9249ed admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.552248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 803/1596] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:39 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:39.552248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6208b1-3370-4d4b-b095-cdb93e513110 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.576944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 794/1597] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:39 2022] PUT /identity/v3/projects/0e0a106dc6294aa889940838bd57c92c/users/0aaf0941153a421ca401cf398e8042ff/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:39.591186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974da9-bc64-43fc-ba5b-dc839e9249ed admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.612896 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6208b1-3370-4d4b-b095-cdb93e513110 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.653013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:39.653188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974da9-bc64-43fc-ba5b-dc839e9249ed admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.656684 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06cf6-7859-4d85-9ffe-25c832135227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.657364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06cf6-7859-4d85-9ffe-25c832135227 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.657722 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06cf6-7859-4d85-9ffe-25c832135227 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.658060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c06cf6-7859-4d85-9ffe-25c832135227 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.658702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c06cf6-7859-4d85-9ffe-25c832135227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.660378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c06cf6-7859-4d85-9ffe-25c832135227 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.671529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 795/1598] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.673361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7900e-3f67-4d9e-9590-f22752c1a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.674059 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7900e-3f67-4d9e-9590-f22752c1a5af admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.677750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7900e-3f67-4d9e-9590-f22752c1a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.677750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7900e-3f67-4d9e-9590-f22752c1a5af admin admin] PATH_INFO: `/v3/projects/f0590f1528d341879dd614b82e6ba9df/users/750a4c0453fe48e8897f729bf1c71c1f/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.678035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06cf6-7859-4d85-9ffe-25c832135227 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.686247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c06cf6-7859-4d85-9ffe-25c832135227 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.692199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee47b5a-9388-4594-93a0-cbb3f81828ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.692551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7900e-3f67-4d9e-9590-f22752c1a5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0590f1528d341879dd614b82e6ba9df, user_id=750a4c0453fe48e8897f729bf1c71c1f, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.692802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee47b5a-9388-4594-93a0-cbb3f81828ab admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.693086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee47b5a-9388-4594-93a0-cbb3f81828ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.693360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee47b5a-9388-4594-93a0-cbb3f81828ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.694055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee47b5a-9388-4594-93a0-cbb3f81828ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.695394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7900e-3f67-4d9e-9590-f22752c1a5af admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.696045 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee47b5a-9388-4594-93a0-cbb3f81828ab admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.706134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 796/1599] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.707588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330f094-2a0b-4075-bc67-b3c2a3f9959c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.707926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330f094-2a0b-4075-bc67-b3c2a3f9959c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.708239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330f094-2a0b-4075-bc67-b3c2a3f9959c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.727048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2330f094-2a0b-4075-bc67-b3c2a3f9959c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:39.728302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2330f094-2a0b-4075-bc67-b3c2a3f9959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:39.736198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 797/1600] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:39.736852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330f094-2a0b-4075-bc67-b3c2a3f9959c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.747394 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330f094-2a0b-4075-bc67-b3c2a3f9959c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.752007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a880d-fe4d-4f46-b631-d2c8b45adae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.752615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a880d-fe4d-4f46-b631-d2c8b45adae8 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.752893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a880d-fe4d-4f46-b631-d2c8b45adae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.753165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a880d-fe4d-4f46-b631-d2c8b45adae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.753793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a880d-fe4d-4f46-b631-d2c8b45adae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.755407 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a880d-fe4d-4f46-b631-d2c8b45adae8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.765573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 798/1601] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:39.766326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a880d-fe4d-4f46-b631-d2c8b45adae8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.775695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a880d-fe4d-4f46-b631-d2c8b45adae8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.780219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982ec56-bbb9-4d84-b793-9804cbe8d8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.780818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ec56-bbb9-4d84-b793-9804cbe8d8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.781097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ec56-bbb9-4d84-b793-9804cbe8d8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.781368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ec56-bbb9-4d84-b793-9804cbe8d8cf admin admin] PATH_INFO: `/v3/projects/01d3d55f3b8b40b6ad0348d9accbb2c0/users/a9ddcfa5e84a405da72e84318be3f308/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.795267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 804/1602] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:39 2022] PUT /identity/v3/projects/f0590f1528d341879dd614b82e6ba9df/users/750a4c0453fe48e8897f729bf1c71c1f/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:39.800551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7900e-3f67-4d9e-9590-f22752c1a5af admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.800675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982ec56-bbb9-4d84-b793-9804cbe8d8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d3d55f3b8b40b6ad0348d9accbb2c0, user_id=a9ddcfa5e84a405da72e84318be3f308, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.800675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982ec56-bbb9-4d84-b793-9804cbe8d8cf admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.858375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7900e-3f67-4d9e-9590-f22752c1a5af admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.863370 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754b9f2-ffd1-4485-abb6-d8d3b3cd49ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.866034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754b9f2-ffd1-4485-abb6-d8d3b3cd49ce admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.866034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754b9f2-ffd1-4485-abb6-d8d3b3cd49ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.866034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754b9f2-ffd1-4485-abb6-d8d3b3cd49ce admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.866034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754b9f2-ffd1-4485-abb6-d8d3b3cd49ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.866993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754b9f2-ffd1-4485-abb6-d8d3b3cd49ce admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.891233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 799/1603] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:39 2022] PUT /identity/v3/projects/01d3d55f3b8b40b6ad0348d9accbb2c0/users/a9ddcfa5e84a405da72e84318be3f308/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:39.892602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17afb4c-1770-4e32-918c-9d3266fe5290 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.893021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17afb4c-1770-4e32-918c-9d3266fe5290 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.894748 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17afb4c-1770-4e32-918c-9d3266fe5290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.921019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e17afb4c-1770-4e32-918c-9d3266fe5290 None None] MFA Rules not processed for user `0aaf0941153a421ca401cf398e8042ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:39.922208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e17afb4c-1770-4e32-918c-9d3266fe5290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:39.965708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 805/1604] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:39 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:39.966535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754b9f2-ffd1-4485-abb6-d8d3b3cd49ce admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.976990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754b9f2-ffd1-4485-abb6-d8d3b3cd49ce admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.986571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 800/1605] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:39.987357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17afb4c-1770-4e32-918c-9d3266fe5290 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:40.010055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:40.037815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42299c76-2b15-4784-b55c-071ba9ddd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.038475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42299c76-2b15-4784-b55c-071ba9ddd114 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.038749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42299c76-2b15-4784-b55c-071ba9ddd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.039858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42299c76-2b15-4784-b55c-071ba9ddd114 admin admin] PATH_INFO: `/v3/projects/7dcf0c06db934bc285b854f66538f3fb/users/440c70c023534045b2d6a095db05302d/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.055170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42299c76-2b15-4784-b55c-071ba9ddd114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dcf0c06db934bc285b854f66538f3fb, user_id=440c70c023534045b2d6a095db05302d, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.057345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17afb4c-1770-4e32-918c-9d3266fe5290 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:40.057972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42299c76-2b15-4784-b55c-071ba9ddd114 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.062906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ae859-2edc-494f-bea7-373b14ecf067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.063946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ae859-2edc-494f-bea7-373b14ecf067 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.064289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ae859-2edc-494f-bea7-373b14ecf067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.064628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ae859-2edc-494f-bea7-373b14ecf067 admin admin] PATH_INFO: `/v3/projects/c8cc6bb589b6485880020109985dcb23/users/2d82e6abf02d471ba464b1c9982ae993/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.079452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ae859-2edc-494f-bea7-373b14ecf067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cc6bb589b6485880020109985dcb23, user_id=2d82e6abf02d471ba464b1c9982ae993, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.082234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ae859-2edc-494f-bea7-373b14ecf067 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.113566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 806/1606] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:39 2022] PUT /identity/v3/projects/7dcf0c06db934bc285b854f66538f3fb/users/440c70c023534045b2d6a095db05302d/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:40.114621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42299c76-2b15-4784-b55c-071ba9ddd114 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:40.118334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-42299c76-2b15-4784-b55c-071ba9ddd114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:40.152335 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:40.166091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 801/1607] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:39 2022] PUT /identity/v3/projects/c8cc6bb589b6485880020109985dcb23/users/2d82e6abf02d471ba464b1c9982ae993/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:40.177746 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42299c76-2b15-4784-b55c-071ba9ddd114 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:40.177935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ae859-2edc-494f-bea7-373b14ecf067 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:40.230298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb8203-2356-402b-97cf-ce1ca14620a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.230912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb8203-2356-402b-97cf-ce1ca14620a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.231195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb8203-2356-402b-97cf-ce1ca14620a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.231498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb8203-2356-402b-97cf-ce1ca14620a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.245688 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ae859-2edc-494f-bea7-373b14ecf067 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:40.250346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66898fd9-c51c-4d1e-bc53-ec2e38bb4ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.250999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66898fd9-c51c-4d1e-bc53-ec2e38bb4ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.251277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66898fd9-c51c-4d1e-bc53-ec2e38bb4ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.251573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66898fd9-c51c-4d1e-bc53-ec2e38bb4ee0 admin admin] PATH_INFO: `/v3/projects/b81bab6b4e434568a69f4bc62b90beba/users/89db202162fc49a6bb184dafcbf2c683/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.266120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66898fd9-c51c-4d1e-bc53-ec2e38bb4ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81bab6b4e434568a69f4bc62b90beba, user_id=89db202162fc49a6bb184dafcbf2c683, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.268826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66898fd9-c51c-4d1e-bc53-ec2e38bb4ee0 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.294852 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb8203-2356-402b-97cf-ce1ca14620a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.296467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb8203-2356-402b-97cf-ce1ca14620a5 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.306394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 807/1608] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:40.307624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9188443-9801-4bfd-90ee-913d3f534df2 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.307912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9188443-9801-4bfd-90ee-913d3f534df2 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.308190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9188443-9801-4bfd-90ee-913d3f534df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.337769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a9188443-9801-4bfd-90ee-913d3f534df2 None None] MFA Rules not processed for user `750a4c0453fe48e8897f729bf1c71c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:40.339025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a9188443-9801-4bfd-90ee-913d3f534df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:40.356048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 802/1609] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:40 2022] PUT /identity/v3/projects/b81bab6b4e434568a69f4bc62b90beba/users/89db202162fc49a6bb184dafcbf2c683/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:40.357436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ae262-bee2-429a-881f-a5a77fe4dc6d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.357719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ae262-bee2-429a-881f-a5a77fe4dc6d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.358150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ae262-bee2-429a-881f-a5a77fe4dc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.378632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-317ae262-bee2-429a-881f-a5a77fe4dc6d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:40.379858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-317ae262-bee2-429a-881f-a5a77fe4dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:40.421143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 808/1610] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:40.422351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9188443-9801-4bfd-90ee-913d3f534df2 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:40.442460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9188443-9801-4bfd-90ee-913d3f534df2 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:40.472828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 803/1611] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:40.473547 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ae262-bee2-429a-881f-a5a77fe4dc6d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:40.493188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:40.528687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:40.537070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e722d72-5d0f-4135-99f1-ce2582483bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.537990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e722d72-5d0f-4135-99f1-ce2582483bfe admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.538646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e722d72-5d0f-4135-99f1-ce2582483bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.539853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e722d72-5d0f-4135-99f1-ce2582483bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.541589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e722d72-5d0f-4135-99f1-ce2582483bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.543402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e722d72-5d0f-4135-99f1-ce2582483bfe admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.559272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 809/1612] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:40.560650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187b7a8-04e4-4572-9071-5743b0a56ae4 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.560937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187b7a8-04e4-4572-9071-5743b0a56ae4 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.561213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187b7a8-04e4-4572-9071-5743b0a56ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.566256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ae262-bee2-429a-881f-a5a77fe4dc6d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:40.570172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52107a06-120c-4b88-94eb-e7da4cefa85a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.570871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52107a06-120c-4b88-94eb-e7da4cefa85a service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.582174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52107a06-120c-4b88-94eb-e7da4cefa85a service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.582174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52107a06-120c-4b88-94eb-e7da4cefa85a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.582412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-9187b7a8-04e4-4572-9071-5743b0a56ae4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:40.582412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9187b7a8-04e4-4572-9071-5743b0a56ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:40.590272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 810/1613] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:40.591412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27bb31-8e03-41c1-958e-621386899e27 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.591700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27bb31-8e03-41c1-958e-621386899e27 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.592454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27bb31-8e03-41c1-958e-621386899e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.629340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ad27bb31-8e03-41c1-958e-621386899e27 None None] MFA Rules not processed for user `2d82e6abf02d471ba464b1c9982ae993`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:40.630668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ad27bb31-8e03-41c1-958e-621386899e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:40.630812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52107a06-120c-4b88-94eb-e7da4cefa85a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.632365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52107a06-120c-4b88-94eb-e7da4cefa85a service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.641896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 804/1614] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:40.645190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b852a0-aee7-400d-9670-9073fcde0c5b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.645552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b852a0-aee7-400d-9670-9073fcde0c5b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.645659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b852a0-aee7-400d-9670-9073fcde0c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.685872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-29b852a0-aee7-400d-9670-9073fcde0c5b None None] MFA Rules not processed for user `89db202162fc49a6bb184dafcbf2c683`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:40.685872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-29b852a0-aee7-400d-9670-9073fcde0c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:40.717091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 811/1615] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:40.719150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe795-b7ba-4585-b5fa-6f523a844dfb None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.720011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe795-b7ba-4585-b5fa-6f523a844dfb None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.720347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe795-b7ba-4585-b5fa-6f523a844dfb None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.721797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 812/1616] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 24 07:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:40.722612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fe795-b7ba-4585-b5fa-6f523a844dfb None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:40.781348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 805/1617] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:40.782174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b852a0-aee7-400d-9670-9073fcde0c5b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:40.790391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fe795-b7ba-4585-b5fa-6f523a844dfb None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:40.797196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c9caf-4718-469a-b75b-bb1a3ba070e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.797891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c9caf-4718-469a-b75b-bb1a3ba070e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.798319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c9caf-4718-469a-b75b-bb1a3ba070e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.798607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b852a0-aee7-400d-9670-9073fcde0c5b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:40.798733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c9caf-4718-469a-b75b-bb1a3ba070e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.805495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01feb5-bff8-49e5-9b24-239db6fde607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.806469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01feb5-bff8-49e5-9b24-239db6fde607 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.806754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01feb5-bff8-49e5-9b24-239db6fde607 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.807026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01feb5-bff8-49e5-9b24-239db6fde607 admin admin] PATH_INFO: `/v3/projects/3fec0e6ee62f47cfbfc234451a83f51b/users/137c88b93a8644539bbc7469732eb1c1/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.809861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c9caf-4718-469a-b75b-bb1a3ba070e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.812146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c9caf-4718-469a-b75b-bb1a3ba070e6 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.823641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 813/1618] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:40.824577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c9caf-4718-469a-b75b-bb1a3ba070e6 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:40.826300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01feb5-bff8-49e5-9b24-239db6fde607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fec0e6ee62f47cfbfc234451a83f51b, user_id=137c88b93a8644539bbc7469732eb1c1, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.829135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01feb5-bff8-49e5-9b24-239db6fde607 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.833887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c9caf-4718-469a-b75b-bb1a3ba070e6 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:40.841843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf9206-dcfb-431e-9e3e-dd44c603c2d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.842421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9206-dcfb-431e-9e3e-dd44c603c2d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.842767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9206-dcfb-431e-9e3e-dd44c603c2d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.843081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9206-dcfb-431e-9e3e-dd44c603c2d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.855758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf9206-dcfb-431e-9e3e-dd44c603c2d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.857288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf9206-dcfb-431e-9e3e-dd44c603c2d4 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.868560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 814/1619] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:40.869405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf9206-dcfb-431e-9e3e-dd44c603c2d4 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:40.879049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf9206-dcfb-431e-9e3e-dd44c603c2d4 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:40.884504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7ad01-9187-4d9a-8580-eb8eca0536a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:40.885088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7ad01-9187-4d9a-8580-eb8eca0536a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.885367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7ad01-9187-4d9a-8580-eb8eca0536a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.885640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7ad01-9187-4d9a-8580-eb8eca0536a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.886256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7ad01-9187-4d9a-8580-eb8eca0536a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:40.888172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7ad01-9187-4d9a-8580-eb8eca0536a1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:40.928074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 806/1620] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:40 2022] PUT /identity/v3/projects/3fec0e6ee62f47cfbfc234451a83f51b/users/137c88b93a8644539bbc7469732eb1c1/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:40.929366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536b2e-05c0-447f-bfce-79a53fd9bfd9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:40.929898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536b2e-05c0-447f-bfce-79a53fd9bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:40.930463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b536b2e-05c0-447f-bfce-79a53fd9bfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:40.984444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3b536b2e-05c0-447f-bfce-79a53fd9bfd9 None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:40.986219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3b536b2e-05c0-447f-bfce-79a53fd9bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:40.991396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 815/1621] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:40 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:40.991396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7ad01-9187-4d9a-8580-eb8eca0536a1 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.007245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:41.020928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:41.058951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7ad01-9187-4d9a-8580-eb8eca0536a1 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.064290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde49591-5d9a-4098-a6bb-6add1f90e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.064910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde49591-5d9a-4098-a6bb-6add1f90e052 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.065195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde49591-5d9a-4098-a6bb-6add1f90e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.065475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde49591-5d9a-4098-a6bb-6add1f90e052 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.066086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 807/1622] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 24 07:54:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:41.066293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde49591-5d9a-4098-a6bb-6add1f90e052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.068413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde49591-5d9a-4098-a6bb-6add1f90e052 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.068537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536b2e-05c0-447f-bfce-79a53fd9bfd9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.080341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b536b2e-05c0-447f-bfce-79a53fd9bfd9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.086989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f899e-ec2b-43d7-9cec-c08d0edda4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.088400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f899e-ec2b-43d7-9cec-c08d0edda4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.088879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f899e-ec2b-43d7-9cec-c08d0edda4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.089370 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f899e-ec2b-43d7-9cec-c08d0edda4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.090719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f899e-ec2b-43d7-9cec-c08d0edda4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.092513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f899e-ec2b-43d7-9cec-c08d0edda4a5 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.108524 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 808/1623] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:41.108524 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f899e-ec2b-43d7-9cec-c08d0edda4a5 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.115860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f899e-ec2b-43d7-9cec-c08d0edda4a5 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.122250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2094b-859f-4a92-913c-7b5e3c7bf6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.122799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2094b-859f-4a92-913c-7b5e3c7bf6aa admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.123098 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2094b-859f-4a92-913c-7b5e3c7bf6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.123405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2094b-859f-4a92-913c-7b5e3c7bf6aa admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.124243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2094b-859f-4a92-913c-7b5e3c7bf6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.126264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2094b-859f-4a92-913c-7b5e3c7bf6aa admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.179349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 816/1624] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:40 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:41.181063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde49591-5d9a-4098-a6bb-6add1f90e052 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.236317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 809/1625] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:41 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:41.238412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2094b-859f-4a92-913c-7b5e3c7bf6aa admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.258462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2094b-859f-4a92-913c-7b5e3c7bf6aa admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.273000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde49591-5d9a-4098-a6bb-6add1f90e052 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.280012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a1405-5585-49e8-87ef-43d3ee3dd55e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.281141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a1405-5585-49e8-87ef-43d3ee3dd55e service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.281141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a1405-5585-49e8-87ef-43d3ee3dd55e service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.281354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a1405-5585-49e8-87ef-43d3ee3dd55e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.369034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a1405-5585-49e8-87ef-43d3ee3dd55e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.369610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c46d8-7bba-4ea7-85f5-f44825dd9b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.370503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c46d8-7bba-4ea7-85f5-f44825dd9b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.370766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a1405-5585-49e8-87ef-43d3ee3dd55e service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.370913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c46d8-7bba-4ea7-85f5-f44825dd9b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.371201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c46d8-7bba-4ea7-85f5-f44825dd9b00 admin admin] PATH_INFO: `/v3/projects/3fec0e6ee62f47cfbfc234451a83f51b/users/137c88b93a8644539bbc7469732eb1c1/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.376900 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c46d8-7bba-4ea7-85f5-f44825dd9b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fec0e6ee62f47cfbfc234451a83f51b, user_id=137c88b93a8644539bbc7469732eb1c1, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.379214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c46d8-7bba-4ea7-85f5-f44825dd9b00 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.381252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 817/1626] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:41.382108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a1405-5585-49e8-87ef-43d3ee3dd55e service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.403020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a1405-5585-49e8-87ef-43d3ee3dd55e service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.412902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278df9f-1b03-4340-bf44-4a4ea9039e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.414304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278df9f-1b03-4340-bf44-4a4ea9039e56 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.414581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278df9f-1b03-4340-bf44-4a4ea9039e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.414857 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278df9f-1b03-4340-bf44-4a4ea9039e56 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.415670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278df9f-1b03-4340-bf44-4a4ea9039e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.417685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278df9f-1b03-4340-bf44-4a4ea9039e56 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.425772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 810/1627] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:41 2022] PUT /identity/v3/projects/3fec0e6ee62f47cfbfc234451a83f51b/users/137c88b93a8644539bbc7469732eb1c1/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:41.426935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c46d8-7bba-4ea7-85f5-f44825dd9b00 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.520201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 818/1628] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:41 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:41.532551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf3ca-653a-4d6b-b15a-2ea6ae95cbe6 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.532551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf3ca-653a-4d6b-b15a-2ea6ae95cbe6 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.532551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaf3ca-653a-4d6b-b15a-2ea6ae95cbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.552884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c46d8-7bba-4ea7-85f5-f44825dd9b00 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.565949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a39ac9-9b41-4f45-9837-4f95c12e41bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.566342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-39eaf3ca-653a-4d6b-b15a-2ea6ae95cbe6 None None] MFA Rules not processed for user `137c88b93a8644539bbc7469732eb1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:41.567724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-39eaf3ca-653a-4d6b-b15a-2ea6ae95cbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:41.568596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39ac9-9b41-4f45-9837-4f95c12e41bf admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.568995 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39ac9-9b41-4f45-9837-4f95c12e41bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.569377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a39ac9-9b41-4f45-9837-4f95c12e41bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.570146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a39ac9-9b41-4f45-9837-4f95c12e41bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.572947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a39ac9-9b41-4f45-9837-4f95c12e41bf admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.582117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:41.609573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 811/1629] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:41.610347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a39ac9-9b41-4f45-9837-4f95c12e41bf admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.637635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a39ac9-9b41-4f45-9837-4f95c12e41bf admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.649662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633580f-3b44-4a86-8834-308cca593018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.650272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633580f-3b44-4a86-8834-308cca593018 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.650566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633580f-3b44-4a86-8834-308cca593018 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.650885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633580f-3b44-4a86-8834-308cca593018 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.651520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633580f-3b44-4a86-8834-308cca593018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.653140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633580f-3b44-4a86-8834-308cca593018 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.679044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 812/1630] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:41.681884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633580f-3b44-4a86-8834-308cca593018 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.706138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633580f-3b44-4a86-8834-308cca593018 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.716885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf186b6-a49c-40cd-a998-104263aafdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.717713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf186b6-a49c-40cd-a998-104263aafdef admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.718087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf186b6-a49c-40cd-a998-104263aafdef admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.718468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf186b6-a49c-40cd-a998-104263aafdef admin admin] PATH_INFO: `/v3/projects/4f746515524e423196f23f724e488a9a/users/8af425da931d464da9af1ce1ecc6aa7d/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.722585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 819/1631] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:41.724629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaf3ca-653a-4d6b-b15a-2ea6ae95cbe6 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.746031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaf3ca-653a-4d6b-b15a-2ea6ae95cbe6 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:41.754629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:41.760454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff339e4-bed9-404c-a000-db06be8ae5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:41.761864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff339e4-bed9-404c-a000-db06be8ae5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:41.762500 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff339e4-bed9-404c-a000-db06be8ae5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:41.762992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff339e4-bed9-404c-a000-db06be8ae5ed admin admin] PATH_INFO: `/v3/projects/7bff8b366ac444ef8e5da871638e7345/users/f3ab03d0154248a292fc103b94f5b452/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:41.779334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf186b6-a49c-40cd-a998-104263aafdef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f746515524e423196f23f724e488a9a, user_id=8af425da931d464da9af1ce1ecc6aa7d, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.782357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf186b6-a49c-40cd-a998-104263aafdef admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.787659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff339e4-bed9-404c-a000-db06be8ae5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bff8b366ac444ef8e5da871638e7345, user_id=f3ab03d0154248a292fc103b94f5b452, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:41.811465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff339e4-bed9-404c-a000-db06be8ae5ed admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:41.921852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 813/1632] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:41 2022] PUT /identity/v3/projects/4f746515524e423196f23f724e488a9a/users/8af425da931d464da9af1ce1ecc6aa7d/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:41.922487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf186b6-a49c-40cd-a998-104263aafdef admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:41.940252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 820/1633] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:41 2022] PUT /identity/v3/projects/7bff8b366ac444ef8e5da871638e7345/users/f3ab03d0154248a292fc103b94f5b452/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:41.941550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff339e4-bed9-404c-a000-db06be8ae5ed admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:42.043630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff339e4-bed9-404c-a000-db06be8ae5ed admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:42.054152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf186b6-a49c-40cd-a998-104263aafdef admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:42.066974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6af28-503f-4257-a1cc-4abe27c84162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:42.066974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6af28-503f-4257-a1cc-4abe27c84162 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.066974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6af28-503f-4257-a1cc-4abe27c84162 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.066974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6af28-503f-4257-a1cc-4abe27c84162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.145511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108c72d-9d92-458b-ad90-6c554827aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:42.146148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108c72d-9d92-458b-ad90-6c554827aace admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.146510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108c72d-9d92-458b-ad90-6c554827aace admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.148208 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108c72d-9d92-458b-ad90-6c554827aace admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.150262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108c72d-9d92-458b-ad90-6c554827aace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:42.152798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108c72d-9d92-458b-ad90-6c554827aace admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:42.170474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 821/1634] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:42.170474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108c72d-9d92-458b-ad90-6c554827aace admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:42.186316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108c72d-9d92-458b-ad90-6c554827aace admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:42.201595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6af28-503f-4257-a1cc-4abe27c84162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:42.205150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6af28-503f-4257-a1cc-4abe27c84162 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:42.221252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0c127-5ee1-4845-b8a4-5f63f77e7134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:42.221893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0c127-5ee1-4845-b8a4-5f63f77e7134 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.222188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0c127-5ee1-4845-b8a4-5f63f77e7134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.222732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0c127-5ee1-4845-b8a4-5f63f77e7134 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.222854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 814/1635] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:42.223187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0c127-5ee1-4845-b8a4-5f63f77e7134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:42.224026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6af28-503f-4257-a1cc-4abe27c84162 service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:42.226573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0c127-5ee1-4845-b8a4-5f63f77e7134 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:42.253318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 822/1636] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:42.254583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0c127-5ee1-4845-b8a4-5f63f77e7134 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:42.260201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6af28-503f-4257-a1cc-4abe27c84162 service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:42.269268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0c127-5ee1-4845-b8a4-5f63f77e7134 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:42.275884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08185a65-375c-482a-b03d-eef45a2ef3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:42.276752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08185a65-375c-482a-b03d-eef45a2ef3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.277242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08185a65-375c-482a-b03d-eef45a2ef3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.277648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08185a65-375c-482a-b03d-eef45a2ef3d1 admin admin] PATH_INFO: `/v3/projects/7bff8b366ac444ef8e5da871638e7345/users/f3ab03d0154248a292fc103b94f5b452/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.280717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a02a-15e2-46ac-9dd8-feaec911b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:42.280904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08185a65-375c-482a-b03d-eef45a2ef3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bff8b366ac444ef8e5da871638e7345, user_id=f3ab03d0154248a292fc103b94f5b452, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:42.281396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a02a-15e2-46ac-9dd8-feaec911b285 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.281687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a02a-15e2-46ac-9dd8-feaec911b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.281964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a02a-15e2-46ac-9dd8-feaec911b285 admin admin] PATH_INFO: `/v3/projects/4f746515524e423196f23f724e488a9a/users/8af425da931d464da9af1ce1ecc6aa7d/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.285055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08185a65-375c-482a-b03d-eef45a2ef3d1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:42.290652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988a02a-15e2-46ac-9dd8-feaec911b285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f746515524e423196f23f724e488a9a, user_id=8af425da931d464da9af1ce1ecc6aa7d, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:42.293462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988a02a-15e2-46ac-9dd8-feaec911b285 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:42.303179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:42.323337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 823/1637] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:42 2022] PUT /identity/v3/projects/7bff8b366ac444ef8e5da871638e7345/users/f3ab03d0154248a292fc103b94f5b452/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:42.325474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 815/1638] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:42 2022] PUT /identity/v3/projects/4f746515524e423196f23f724e488a9a/users/8af425da931d464da9af1ce1ecc6aa7d/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:42.329855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ef38e-29be-4c48-be54-424e916d7ee9 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.330326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ef38e-29be-4c48-be54-424e916d7ee9 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.330860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ef38e-29be-4c48-be54-424e916d7ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.333395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380f4ac-1594-43ff-83db-0205766d2a4e None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.333787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380f4ac-1594-43ff-83db-0205766d2a4e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.334181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380f4ac-1594-43ff-83db-0205766d2a4e None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.336341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 816/1639] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 24 07:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:54:42.337880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15610b5-97ed-40e9-9179-f740b144484c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.338260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15610b5-97ed-40e9-9179-f740b144484c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.339188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15610b5-97ed-40e9-9179-f740b144484c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.411514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e15610b5-97ed-40e9-9179-f740b144484c None None] MFA Rules not processed for user `8af425da931d464da9af1ce1ecc6aa7d`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:42.413580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e15610b5-97ed-40e9-9179-f740b144484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:42.431871 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c92ef38e-29be-4c48-be54-424e916d7ee9 None None] MFA Rules not processed for user `f3ab03d0154248a292fc103b94f5b452`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:42.440415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c92ef38e-29be-4c48-be54-424e916d7ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:42.540242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 824/1641] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:42.543935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 817/1641] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:42.543935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15610b5-97ed-40e9-9179-f740b144484c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:42.554244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8794-887d-4e8e-bd97-303ff465505e None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.554519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8794-887d-4e8e-bd97-303ff465505e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.555781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd8794-887d-4e8e-bd97-303ff465505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.560827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:42.579822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-42dd8794-887d-4e8e-bd97-303ff465505e None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:42.581015 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-42dd8794-887d-4e8e-bd97-303ff465505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:42.628088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15610b5-97ed-40e9-9179-f740b144484c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:42.633640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524cbc1-52c9-4960-8aaf-f5c88f74a612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:42.634798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524cbc1-52c9-4960-8aaf-f5c88f74a612 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.635092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524cbc1-52c9-4960-8aaf-f5c88f74a612 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.635399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524cbc1-52c9-4960-8aaf-f5c88f74a612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.685832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 825/1642] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 24 07:54:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:42.688377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8794-887d-4e8e-bd97-303ff465505e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:42.703878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd8794-887d-4e8e-bd97-303ff465505e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:42.711522 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d74fcb-a0a8-4431-a65e-7b24860fbaa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:42.713272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d74fcb-a0a8-4431-a65e-7b24860fbaa7 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.713968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d74fcb-a0a8-4431-a65e-7b24860fbaa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.714455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d74fcb-a0a8-4431-a65e-7b24860fbaa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.729344 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524cbc1-52c9-4960-8aaf-f5c88f74a612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:42.731264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524cbc1-52c9-4960-8aaf-f5c88f74a612 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:42.732553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d74fcb-a0a8-4431-a65e-7b24860fbaa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:42.741454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d74fcb-a0a8-4431-a65e-7b24860fbaa7 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:42.742736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 818/1643] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:42.759387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b63ee-4a5e-4438-89bb-1d1535d08a29 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.759669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b63ee-4a5e-4438-89bb-1d1535d08a29 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.759957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b63ee-4a5e-4438-89bb-1d1535d08a29 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.765433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 819/1644] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 24 07:54:42 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:42.768114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc3251-ef8d-4424-82fa-8b840d0fe022 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.768405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc3251-ef8d-4424-82fa-8b840d0fe022 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.768678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc3251-ef8d-4424-82fa-8b840d0fe022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.771668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 826/1645] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:42.821228 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-41bc3251-ef8d-4424-82fa-8b840d0fe022 None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:42.822898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-41bc3251-ef8d-4424-82fa-8b840d0fe022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:42.832483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 820/1646] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:54:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:42.908748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d74fcb-a0a8-4431-a65e-7b24860fbaa7 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:42.921343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d74fcb-a0a8-4431-a65e-7b24860fbaa7 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:42.931862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e6a2-d08b-4e7a-ab48-101d2095653e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:42.932543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e6a2-d08b-4e7a-ab48-101d2095653e service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.932956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e6a2-d08b-4e7a-ab48-101d2095653e service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.933118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e6a2-d08b-4e7a-ab48-101d2095653e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.944187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e6a2-d08b-4e7a-ab48-101d2095653e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:42.950039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e6a2-d08b-4e7a-ab48-101d2095653e service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:42.969261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 827/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:43.438298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc3251-ef8d-4424-82fa-8b840d0fe022 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:43.438298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc3251-ef8d-4424-82fa-8b840d0fe022 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:43.438298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234cb09-1732-41f3-ba7b-6c50ce881045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:43.438298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cb09-1732-41f3-ba7b-6c50ce881045 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:43.445730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cb09-1732-41f3-ba7b-6c50ce881045 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:43.445730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234cb09-1732-41f3-ba7b-6c50ce881045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:43.445730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234cb09-1732-41f3-ba7b-6c50ce881045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:43.445730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234cb09-1732-41f3-ba7b-6c50ce881045 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:43.445730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 821/1648] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:43.449079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ade7a-8e7d-4ae5-a350-b3725f1e1f0b None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:43.449079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ade7a-8e7d-4ae5-a350-b3725f1e1f0b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:43.449079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ade7a-8e7d-4ae5-a350-b3725f1e1f0b None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:43.449079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 828/1649] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 24 07:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:43.453083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963bcf0-3015-4d09-9d71-37acb3c240a5 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:43.453083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963bcf0-3015-4d09-9d71-37acb3c240a5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:43.453083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963bcf0-3015-4d09-9d71-37acb3c240a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:43.453083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d963bcf0-3015-4d09-9d71-37acb3c240a5 None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:43.453083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d963bcf0-3015-4d09-9d71-37acb3c240a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:43.453083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 822/1650] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:54:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:43.710447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ade7a-8e7d-4ae5-a350-b3725f1e1f0b None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:43.738463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ade7a-8e7d-4ae5-a350-b3725f1e1f0b None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:43.752844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da63d-4863-411c-b978-7b8e2a929ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:43.753487 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da63d-4863-411c-b978-7b8e2a929ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:43.753758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da63d-4863-411c-b978-7b8e2a929ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:43.754032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08da63d-4863-411c-b978-7b8e2a929ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:43.775731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08da63d-4863-411c-b978-7b8e2a929ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:43.777205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08da63d-4863-411c-b978-7b8e2a929ea4 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:43.799188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 829/1651] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:43.862605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963bcf0-3015-4d09-9d71-37acb3c240a5 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:43.886203 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963bcf0-3015-4d09-9d71-37acb3c240a5 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:43.895823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d5eb1-60de-4e4f-bc57-2be0ce358d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:43.897229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d5eb1-60de-4e4f-bc57-2be0ce358d09 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:43.899076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d5eb1-60de-4e4f-bc57-2be0ce358d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:43.899769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d5eb1-60de-4e4f-bc57-2be0ce358d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:43.980546 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d5eb1-60de-4e4f-bc57-2be0ce358d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:43.982210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d5eb1-60de-4e4f-bc57-2be0ce358d09 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:44.013607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 823/1652] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:44.530701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da63d-4863-411c-b978-7b8e2a929ea4 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:44.609770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:44.660656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08da63d-4863-411c-b978-7b8e2a929ea4 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:44.668682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:44.669906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:44.670403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:44.670888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] PATH_INFO: `/v3/users/750a4c0453fe48e8897f729bf1c71c1f` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:44.672458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=750a4c0453fe48e8897f729bf1c71c1f)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:44.674819 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:44.966380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750a4c0453fe48e8897f729bf1c71c1f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:44.969998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750a4c0453fe48e8897f729bf1c71c1f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:44.971606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750a4c0453fe48e8897f729bf1c71c1f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:45.020227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750a4c0453fe48e8897f729bf1c71c1f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:45.114232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750a4c0453fe48e8897f729bf1c71c1f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:45.163460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 830/1653] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:54:44 2022] DELETE /identity/v3/users/750a4c0453fe48e8897f729bf1c71c1f => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:45.168463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0249a0-db57-40ab-a30e-d379b299b07f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:45.168972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0249a0-db57-40ab-a30e-d379b299b07f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:45.169044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0249a0-db57-40ab-a30e-d379b299b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:45.224540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8d0249a0-db57-40ab-a30e-d379b299b07f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:45.225988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8d0249a0-db57-40ab-a30e-d379b299b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:45.331001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:45.473231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 824/1654] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:45.513716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:45.515824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:45.744495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7e1e-afe9-4905-847a-85ee342df9e8 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:45.752800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d55985-231e-4214-aed7-86ce3630bf86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:45.760911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d55985-231e-4214-aed7-86ce3630bf86 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:45.763604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d55985-231e-4214-aed7-86ce3630bf86 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:45.764032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d55985-231e-4214-aed7-86ce3630bf86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:45.805847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d55985-231e-4214-aed7-86ce3630bf86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:45.806343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d55985-231e-4214-aed7-86ce3630bf86 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:45.832156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 831/1655] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:47.482879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0249a0-db57-40ab-a30e-d379b299b07f None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:47.489720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8d0249a0-db57-40ab-a30e-d379b299b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:47.514127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0249a0-db57-40ab-a30e-d379b299b07f None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:47.521198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:47.522122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:47.522463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:47.523696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] PATH_INFO: `/v3/users/2d82e6abf02d471ba464b1c9982ae993` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:47.525408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d82e6abf02d471ba464b1c9982ae993)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:47.526798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: WARNING py.warnings [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:54:47.526798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: warnings.warn(msg) Aug 24 07:54:47.526798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: Aug 24 07:54:47.528601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:47.865463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d82e6abf02d471ba464b1c9982ae993'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:47.875781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d82e6abf02d471ba464b1c9982ae993'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:47.888756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d82e6abf02d471ba464b1c9982ae993'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:47.950499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d55985-231e-4214-aed7-86ce3630bf86 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:47.952899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-48d55985-231e-4214-aed7-86ce3630bf86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:47.985244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d55985-231e-4214-aed7-86ce3630bf86 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:48.007197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:48.011682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:48.012257 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:48.012721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] PATH_INFO: `/v3/projects/f0590f1528d341879dd614b82e6ba9df` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:48.019060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0590f1528d341879dd614b82e6ba9df)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:48.020444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: WARNING py.warnings [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:54:48.020444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: warnings.warn(msg) Aug 24 07:54:48.020444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: Aug 24 07:54:48.023517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d82e6abf02d471ba464b1c9982ae993'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:48.024739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:48.078859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0a4f117c-3c93-41b8-a630-c2b3f9edae52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d82e6abf02d471ba464b1c9982ae993'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:48.143437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 825/1656] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:54:47 2022] DELETE /identity/v3/users/2d82e6abf02d471ba464b1c9982ae993 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:48.150033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de04e9d-142b-43c8-bc97-dda41969da51 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:48.150465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de04e9d-142b-43c8-bc97-dda41969da51 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:48.151207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de04e9d-142b-43c8-bc97-dda41969da51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:48.219572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-9de04e9d-142b-43c8-bc97-dda41969da51 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:48.223542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9de04e9d-142b-43c8-bc97-dda41969da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:48.291601 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0590f1528d341879dd614b82e6ba9df', 'request_id': 'req-f42d299b-4117-4636-b0dc-cfa70b2aaffb'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:48.303040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:48.395576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 826/1657] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:54:48.399831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0590f1528d341879dd614b82e6ba9df', 'request_id': 'req-f42d299b-4117-4636-b0dc-cfa70b2aaffb'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:48.425236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0590f1528d341879dd614b82e6ba9df', 'request_id': 'req-f42d299b-4117-4636-b0dc-cfa70b2aaffb'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:48.436374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de04e9d-142b-43c8-bc97-dda41969da51 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:48.441759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9de04e9d-142b-43c8-bc97-dda41969da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:48.461340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] The token cache is being invalidate because project f0590f1528d341879dd614b82e6ba9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:54:48.461859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:48.463697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f42d299b-4117-4636-b0dc-cfa70b2aaffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:48.466769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 832/1658] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:54:47 2022] DELETE /identity/v3/projects/f0590f1528d341879dd614b82e6ba9df => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:48.475699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a2411-a553-4095-a7f3-c8ea0614f002 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:48.476695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a2411-a553-4095-a7f3-c8ea0614f002 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:48.477219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a2411-a553-4095-a7f3-c8ea0614f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:48.528331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-267a2411-a553-4095-a7f3-c8ea0614f002 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:48.529233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-267a2411-a553-4095-a7f3-c8ea0614f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:48.560258 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 833/1659] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:48.561824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eac3e-4676-44b3-956f-1a61143103be None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:48.562241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eac3e-4676-44b3-956f-1a61143103be None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:48.562537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386eac3e-4676-44b3-956f-1a61143103be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:48.586089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:48.595237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de04e9d-142b-43c8-bc97-dda41969da51 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:48.604308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf0d18-83df-482c-8009-773b276c0aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:48.604308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf0d18-83df-482c-8009-773b276c0aea service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:48.604562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf0d18-83df-482c-8009-773b276c0aea service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:48.604842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf0d18-83df-482c-8009-773b276c0aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:48.606907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ecbf0d18-83df-482c-8009-773b276c0aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:48.623144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-386eac3e-4676-44b3-956f-1a61143103be None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:48.625493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-386eac3e-4676-44b3-956f-1a61143103be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:48.639321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 834/1660] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:48.644448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf0d18-83df-482c-8009-773b276c0aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:48.647405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eac3e-4676-44b3-956f-1a61143103be None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:48.652539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf0d18-83df-482c-8009-773b276c0aea service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:48.664479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386eac3e-4676-44b3-956f-1a61143103be None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:48.675325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101e1b0-5093-48a7-a5e8-8a295e0ff610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:48.681609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101e1b0-5093-48a7-a5e8-8a295e0ff610 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:48.682457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101e1b0-5093-48a7-a5e8-8a295e0ff610 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:48.682821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101e1b0-5093-48a7-a5e8-8a295e0ff610 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:48.683691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101e1b0-5093-48a7-a5e8-8a295e0ff610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:48.684332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101e1b0-5093-48a7-a5e8-8a295e0ff610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:48.686248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101e1b0-5093-48a7-a5e8-8a295e0ff610 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:48.693807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 827/1661] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:48.734833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 835/1662] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:48.736328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf0d18-83df-482c-8009-773b276c0aea service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:48.747697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf0d18-83df-482c-8009-773b276c0aea service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:48.752899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274e21c-0032-4ef6-8d10-515e7242a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:48.753536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274e21c-0032-4ef6-8d10-515e7242a611 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:48.753826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274e21c-0032-4ef6-8d10-515e7242a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:48.754101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274e21c-0032-4ef6-8d10-515e7242a611 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:48.754733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274e21c-0032-4ef6-8d10-515e7242a611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:48.758944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274e21c-0032-4ef6-8d10-515e7242a611 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:48.918678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 828/1663] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:48 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:48.924493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101e1b0-5093-48a7-a5e8-8a295e0ff610 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:48.942390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101e1b0-5093-48a7-a5e8-8a295e0ff610 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:49.104570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff8634-e8cf-4180-8b25-f19e6db38b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:49.105181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff8634-e8cf-4180-8b25-f19e6db38b9b admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:49.105470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff8634-e8cf-4180-8b25-f19e6db38b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:49.106547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff8634-e8cf-4180-8b25-f19e6db38b9b admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:49.107200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff8634-e8cf-4180-8b25-f19e6db38b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:49.109179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff8634-e8cf-4180-8b25-f19e6db38b9b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:49.206051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 836/1664] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:48 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:49.213798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274e21c-0032-4ef6-8d10-515e7242a611 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:49.229916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274e21c-0032-4ef6-8d10-515e7242a611 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:49.249110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd86ee-2ed5-4d86-9138-d9f9e74a9de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:49.249744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd86ee-2ed5-4d86-9138-d9f9e74a9de8 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:49.250031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd86ee-2ed5-4d86-9138-d9f9e74a9de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:49.250421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd86ee-2ed5-4d86-9138-d9f9e74a9de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:49.251211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd86ee-2ed5-4d86-9138-d9f9e74a9de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:49.252799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd86ee-2ed5-4d86-9138-d9f9e74a9de8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:49.283166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff8634-e8cf-4180-8b25-f19e6db38b9b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:49.297854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 829/1665] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:49.307846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff8634-e8cf-4180-8b25-f19e6db38b9b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:49.322440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc32bc-f33c-4842-8c4c-b771b54e09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:49.323803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc32bc-f33c-4842-8c4c-b771b54e09ce admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:49.324701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc32bc-f33c-4842-8c4c-b771b54e09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:49.325175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc32bc-f33c-4842-8c4c-b771b54e09ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:49.327375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc32bc-f33c-4842-8c4c-b771b54e09ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:49.331394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc32bc-f33c-4842-8c4c-b771b54e09ce admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:49.371564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 837/1666] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:49.374820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd86ee-2ed5-4d86-9138-d9f9e74a9de8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:49.390824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd86ee-2ed5-4d86-9138-d9f9e74a9de8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:49.406446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bc927-4e87-4d63-9c89-bff802919a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:49.407299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bc927-4e87-4d63-9c89-bff802919a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:49.407694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bc927-4e87-4d63-9c89-bff802919a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:49.408099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bc927-4e87-4d63-9c89-bff802919a66 admin admin] PATH_INFO: `/v3/projects/855050dd718a49fcb847501c3393a6d5/users/b7238e7c8a9e4e22bb047bad10856218/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:49.440039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bc927-4e87-4d63-9c89-bff802919a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855050dd718a49fcb847501c3393a6d5, user_id=b7238e7c8a9e4e22bb047bad10856218, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:49.443003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bc927-4e87-4d63-9c89-bff802919a66 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:49.559190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 830/1667] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:49 2022] PUT /identity/v3/projects/855050dd718a49fcb847501c3393a6d5/users/b7238e7c8a9e4e22bb047bad10856218/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:54:49.573510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47023-ea94-4320-af08-e17cec8c2d14 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:49.573871 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47023-ea94-4320-af08-e17cec8c2d14 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:49.574318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47023-ea94-4320-af08-e17cec8c2d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:49.635919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6ea47023-ea94-4320-af08-e17cec8c2d14 None None] MFA Rules not processed for user `b7238e7c8a9e4e22bb047bad10856218`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:49.637165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6ea47023-ea94-4320-af08-e17cec8c2d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:49.800497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 838/1668] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:49.800681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bc927-4e87-4d63-9c89-bff802919a66 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:49.970924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bc927-4e87-4d63-9c89-bff802919a66 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:49.978115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c8eaa-38b5-49dd-a714-ad4facf67e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:49.978943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c8eaa-38b5-49dd-a714-ad4facf67e1c admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:49.982115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c8eaa-38b5-49dd-a714-ad4facf67e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:49.982115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c8eaa-38b5-49dd-a714-ad4facf67e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:49.982115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c8eaa-38b5-49dd-a714-ad4facf67e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:49.983242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c8eaa-38b5-49dd-a714-ad4facf67e1c admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:50.113596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 831/1669] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:49 2022] POST /identity/v3/projects => generated 367 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:54:50.117264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea47023-ea94-4320-af08-e17cec8c2d14 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:50.145104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cdf70-597f-473f-94ae-11592cedebc9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:50.145400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cdf70-597f-473f-94ae-11592cedebc9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:50.145678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cdf70-597f-473f-94ae-11592cedebc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:50.151945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea47023-ea94-4320-af08-e17cec8c2d14 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:50.206251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:50.233951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ed4cdf70-597f-473f-94ae-11592cedebc9 None None] MFA Rules not processed for user `e618ac2e8e884988b42a1d8b195eb457`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:50.235211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ed4cdf70-597f-473f-94ae-11592cedebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:50.339274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c9dba-8235-416e-9982-f2b8dc7a28d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:50.342328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c9dba-8235-416e-9982-f2b8dc7a28d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:50.342328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c9dba-8235-416e-9982-f2b8dc7a28d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:50.342328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c9dba-8235-416e-9982-f2b8dc7a28d6 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:50.342328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c9dba-8235-416e-9982-f2b8dc7a28d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:50.347026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c9dba-8235-416e-9982-f2b8dc7a28d6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:50.403491 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 832/1670] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:50.404486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cdf70-597f-473f-94ae-11592cedebc9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:50.411083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ed4cdf70-597f-473f-94ae-11592cedebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:50.440173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cdf70-597f-473f-94ae-11592cedebc9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:50.445487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:50.446355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:50.446745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:50.447220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] PATH_INFO: `/v3/projects/c8cc6bb589b6485880020109985dcb23` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:50.448743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8cc6bb589b6485880020109985dcb23)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:50.451246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:50.490303 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 839/1671] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:50 2022] POST /identity/v3/users => generated 290 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:50.492106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c9dba-8235-416e-9982-f2b8dc7a28d6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:50.498279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9b0c9dba-8235-416e-9982-f2b8dc7a28d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:50.556926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:50.633860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8cc6bb589b6485880020109985dcb23', 'request_id': 'req-44329b44-4443-45cd-b041-e347bf1b42a2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:50.659420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8cc6bb589b6485880020109985dcb23', 'request_id': 'req-44329b44-4443-45cd-b041-e347bf1b42a2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:50.696719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c9dba-8235-416e-9982-f2b8dc7a28d6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:50.754461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8cc6bb589b6485880020109985dcb23', 'request_id': 'req-44329b44-4443-45cd-b041-e347bf1b42a2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:50.778051 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] The token cache is being invalidate because project c8cc6bb589b6485880020109985dcb23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:54:50.780173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:50.784022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:50.795642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 833/1672] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:54:50 2022] DELETE /identity/v3/projects/c8cc6bb589b6485880020109985dcb23 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:50.796801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:50.798331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:50.831149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a435a-5655-44af-9881-45921da875f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:50.832176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a435a-5655-44af-9881-45921da875f7 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:50.832606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a435a-5655-44af-9881-45921da875f7 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:50.833019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a435a-5655-44af-9881-45921da875f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:50.835999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-320a435a-5655-44af-9881-45921da875f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:50.947568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44329b44-4443-45cd-b041-e347bf1b42a2 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:50.962106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92347e6a-3c4d-4b45-8a42-8e2d98ee107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:50.966408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a435a-5655-44af-9881-45921da875f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:50.975821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92347e6a-3c4d-4b45-8a42-8e2d98ee107f admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:50.975821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92347e6a-3c4d-4b45-8a42-8e2d98ee107f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:50.975821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92347e6a-3c4d-4b45-8a42-8e2d98ee107f admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:50.976230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a435a-5655-44af-9881-45921da875f7 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:50.976298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92347e6a-3c4d-4b45-8a42-8e2d98ee107f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:50.976298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92347e6a-3c4d-4b45-8a42-8e2d98ee107f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:50.986671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 840/1673] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:50.987177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a435a-5655-44af-9881-45921da875f7 service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:50.989505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-320a435a-5655-44af-9881-45921da875f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:51.007217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 834/1674] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:51.010287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a435a-5655-44af-9881-45921da875f7 service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:51.011804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92347e6a-3c4d-4b45-8a42-8e2d98ee107f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:51.020766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:51.020766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:51.020766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:51.020766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] PATH_INFO: `/v3/users/8af425da931d464da9af1ce1ecc6aa7d` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:51.030274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af425da931d464da9af1ce1ecc6aa7d)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:51.037245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92347e6a-3c4d-4b45-8a42-8e2d98ee107f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:51.039529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:51.052428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3f4f-8044-450f-adc6-4e5e72bf7b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:51.053518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3f4f-8044-450f-adc6-4e5e72bf7b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:51.055022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3f4f-8044-450f-adc6-4e5e72bf7b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:51.055866 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3f4f-8044-450f-adc6-4e5e72bf7b8a admin admin] PATH_INFO: `/v3/projects/679b7ccf3b0349b5afeb9bd4e3ac74ae/users/ae61bc9f60c7460d9c355755c1eed23c/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:51.099071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b3f4f-8044-450f-adc6-4e5e72bf7b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=679b7ccf3b0349b5afeb9bd4e3ac74ae, user_id=ae61bc9f60c7460d9c355755c1eed23c, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:51.107876 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b3f4f-8044-450f-adc6-4e5e72bf7b8a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:51.192446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 835/1675] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:51 2022] PUT /identity/v3/projects/679b7ccf3b0349b5afeb9bd4e3ac74ae/users/ae61bc9f60c7460d9c355755c1eed23c/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:54:51.197301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3f4f-8044-450f-adc6-4e5e72bf7b8a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:51.334082 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af425da931d464da9af1ce1ecc6aa7d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:51.340133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af425da931d464da9af1ce1ecc6aa7d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:51.341326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af425da931d464da9af1ce1ecc6aa7d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:51.373921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af425da931d464da9af1ce1ecc6aa7d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:51.394340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3f4f-8044-450f-adc6-4e5e72bf7b8a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:51.408011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1977f-36cf-43e8-8357-312232f6c186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:51.408769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1977f-36cf-43e8-8357-312232f6c186 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:51.409901 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1977f-36cf-43e8-8357-312232f6c186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:51.410245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1977f-36cf-43e8-8357-312232f6c186 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:51.410974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1977f-36cf-43e8-8357-312232f6c186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:51.416306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1977f-36cf-43e8-8357-312232f6c186 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:51.440325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 836/1676] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:51.441677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1977f-36cf-43e8-8357-312232f6c186 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:51.455597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-57b1977f-36cf-43e8-8357-312232f6c186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:51.474014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7f1a286a-9595-4388-b2d1-548bbf9285bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af425da931d464da9af1ce1ecc6aa7d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:51.501656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 841/1677] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:54:50 2022] DELETE /identity/v3/users/8af425da931d464da9af1ce1ecc6aa7d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:51.508454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1977f-36cf-43e8-8357-312232f6c186 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:51.628129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d8fa-552c-4b93-ad14-15aa7e874d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:51.628606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d8fa-552c-4b93-ad14-15aa7e874d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:51.628985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d8fa-552c-4b93-ad14-15aa7e874d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:51.629359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d8fa-552c-4b93-ad14-15aa7e874d77 admin admin] PATH_INFO: `/v3/projects/679b7ccf3b0349b5afeb9bd4e3ac74ae/users/ae61bc9f60c7460d9c355755c1eed23c/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:51.631501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d8fa-552c-4b93-ad14-15aa7e874d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679b7ccf3b0349b5afeb9bd4e3ac74ae, user_id=ae61bc9f60c7460d9c355755c1eed23c, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:51.635598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d8fa-552c-4b93-ad14-15aa7e874d77 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:51.656491 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 837/1678] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:51 2022] PUT /identity/v3/projects/679b7ccf3b0349b5afeb9bd4e3ac74ae/users/ae61bc9f60c7460d9c355755c1eed23c/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:51.664296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0b8c7-444f-47c7-be02-dc1744be30e1 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:51.664296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0b8c7-444f-47c7-be02-dc1744be30e1 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:51.664296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0b8c7-444f-47c7-be02-dc1744be30e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:51.707995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-46c0b8c7-444f-47c7-be02-dc1744be30e1 None None] MFA Rules not processed for user `ae61bc9f60c7460d9c355755c1eed23c`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:51.709590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-46c0b8c7-444f-47c7-be02-dc1744be30e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:51.840403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:51.885245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 842/1679] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:52.198591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d8fa-552c-4b93-ad14-15aa7e874d77 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:52.204806 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8aa5d8fa-552c-4b93-ad14-15aa7e874d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:52.250962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:52.424561 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d8fa-552c-4b93-ad14-15aa7e874d77 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:52.437287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ac91f-4384-4574-848d-749b976c87fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:52.438162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ac91f-4384-4574-848d-749b976c87fc service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:52.438601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ac91f-4384-4574-848d-749b976c87fc service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:52.439012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ac91f-4384-4574-848d-749b976c87fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:52.459872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ac91f-4384-4574-848d-749b976c87fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:52.461733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ac91f-4384-4574-848d-749b976c87fc service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:52.489869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 838/1680] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:52.698219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0b8c7-444f-47c7-be02-dc1744be30e1 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:52.699814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-46c0b8c7-444f-47c7-be02-dc1744be30e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:52.848909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0b8c7-444f-47c7-be02-dc1744be30e1 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:52.862787 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:52.863512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:52.863973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:52.864486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] PATH_INFO: `/v3/projects/4f746515524e423196f23f724e488a9a` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:52.865680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f746515524e423196f23f724e488a9a)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:52.869043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:53.076583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f746515524e423196f23f724e488a9a', 'request_id': 'req-663cb625-2e1c-415d-89f7-893707ae91dd'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:53.149125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f746515524e423196f23f724e488a9a', 'request_id': 'req-663cb625-2e1c-415d-89f7-893707ae91dd'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:53.160236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f746515524e423196f23f724e488a9a', 'request_id': 'req-663cb625-2e1c-415d-89f7-893707ae91dd'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:53.190074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] The token cache is being invalidate because project 4f746515524e423196f23f724e488a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:54:53.190376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:53.191227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-663cb625-2e1c-415d-89f7-893707ae91dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:53.201286 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 843/1681] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:54:52 2022] DELETE /identity/v3/projects/4f746515524e423196f23f724e488a9a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:53.206361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed198c-5ae6-4de6-aced-b9ba19db5d6f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:53.206841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed198c-5ae6-4de6-aced-b9ba19db5d6f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:53.206910 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed198c-5ae6-4de6-aced-b9ba19db5d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:53.284147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-5bed198c-5ae6-4de6-aced-b9ba19db5d6f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:53.284147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5bed198c-5ae6-4de6-aced-b9ba19db5d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:53.443739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 839/1682] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:53.451925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026b068-42fe-443e-8e8c-38391164b98c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:53.452297 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026b068-42fe-443e-8e8c-38391164b98c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:53.452648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026b068-42fe-443e-8e8c-38391164b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:53.498631 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6026b068-42fe-443e-8e8c-38391164b98c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:53.502552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6026b068-42fe-443e-8e8c-38391164b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:53.520636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 844/1683] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:53.525449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed198c-5ae6-4de6-aced-b9ba19db5d6f None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:53.539249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed198c-5ae6-4de6-aced-b9ba19db5d6f None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:53.549305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54639718-1e66-4dad-b048-7fa0a0da742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:53.550271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54639718-1e66-4dad-b048-7fa0a0da742f admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:53.550771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54639718-1e66-4dad-b048-7fa0a0da742f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:53.551233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54639718-1e66-4dad-b048-7fa0a0da742f admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:53.552140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54639718-1e66-4dad-b048-7fa0a0da742f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:53.552640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54639718-1e66-4dad-b048-7fa0a0da742f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:53.555707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54639718-1e66-4dad-b048-7fa0a0da742f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:53.590275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 840/1684] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:53.598259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026b068-42fe-443e-8e8c-38391164b98c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:53.611559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026b068-42fe-443e-8e8c-38391164b98c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:53.625175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d6e64-2925-4a69-9c6c-4eaa5193de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:53.625808 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d6e64-2925-4a69-9c6c-4eaa5193de48 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:53.626114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d6e64-2925-4a69-9c6c-4eaa5193de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:53.626380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d6e64-2925-4a69-9c6c-4eaa5193de48 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:53.627005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d6e64-2925-4a69-9c6c-4eaa5193de48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:53.629058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d6e64-2925-4a69-9c6c-4eaa5193de48 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:53.769133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 845/1685] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:53 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:53.779153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54639718-1e66-4dad-b048-7fa0a0da742f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:53.796665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54639718-1e66-4dad-b048-7fa0a0da742f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:53.903796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:53.970161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b561f1-7a5a-4338-ab17-0061ce6f3546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:53.970931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b561f1-7a5a-4338-ab17-0061ce6f3546 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:53.971216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b561f1-7a5a-4338-ab17-0061ce6f3546 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:53.972563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b561f1-7a5a-4338-ab17-0061ce6f3546 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:53.973820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b561f1-7a5a-4338-ab17-0061ce6f3546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:53.977720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b561f1-7a5a-4338-ab17-0061ce6f3546 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:54.078469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 841/1686] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:53 2022] POST /identity/v3/users => generated 292 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:54.082070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae2218-5b59-4f41-8135-23c4023d6b90 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:54.082637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae2218-5b59-4f41-8135-23c4023d6b90 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:54.083113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b561f1-7a5a-4338-ab17-0061ce6f3546 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:54.083375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae2218-5b59-4f41-8135-23c4023d6b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:54.104826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b561f1-7a5a-4338-ab17-0061ce6f3546 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:54.120132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d4e73-4a04-45c9-b23d-e3d8dfd1213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:54.121292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d4e73-4a04-45c9-b23d-e3d8dfd1213a admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:54.121914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d4e73-4a04-45c9-b23d-e3d8dfd1213a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:54.122432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d4e73-4a04-45c9-b23d-e3d8dfd1213a admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:54.123268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d4e73-4a04-45c9-b23d-e3d8dfd1213a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:54.125029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d4e73-4a04-45c9-b23d-e3d8dfd1213a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:54.137907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3cae2218-5b59-4f41-8135-23c4023d6b90 None None] MFA Rules not processed for user `a9ddcfa5e84a405da72e84318be3f308`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:54.139461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3cae2218-5b59-4f41-8135-23c4023d6b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:54.170025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 842/1687] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:54:54.179498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d4e73-4a04-45c9-b23d-e3d8dfd1213a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:54.212833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d4e73-4a04-45c9-b23d-e3d8dfd1213a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:54.238396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 846/1688] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:54.249874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e478a5-b929-4af4-bdfa-0fd42f6c1604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:54.253426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e478a5-b929-4af4-bdfa-0fd42f6c1604 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:54.255087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef302ce-23dd-4ff6-ab70-ef8544b314c2 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:54.255411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef302ce-23dd-4ff6-ab70-ef8544b314c2 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:54.255798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e478a5-b929-4af4-bdfa-0fd42f6c1604 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:54.256580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e478a5-b929-4af4-bdfa-0fd42f6c1604 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:54.257912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef302ce-23dd-4ff6-ab70-ef8544b314c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:54.258030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e478a5-b929-4af4-bdfa-0fd42f6c1604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:54.261202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e478a5-b929-4af4-bdfa-0fd42f6c1604 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:54.286890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 843/1689] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:54.298366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e478a5-b929-4af4-bdfa-0fd42f6c1604 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:54.308528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8ef302ce-23dd-4ff6-ab70-ef8544b314c2 None None] MFA Rules not processed for user `a9ddcfa5e84a405da72e84318be3f308`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:54.311406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8ef302ce-23dd-4ff6-ab70-ef8544b314c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:54.323126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:54.342445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 847/1690] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:54.348420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef302ce-23dd-4ff6-ab70-ef8544b314c2 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:54.351993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e478a5-b929-4af4-bdfa-0fd42f6c1604 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:54.355993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8ef302ce-23dd-4ff6-ab70-ef8544b314c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:54.385334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85be6a-4143-470c-bf7b-f602d0a10083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:54.388445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85be6a-4143-470c-bf7b-f602d0a10083 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:54.390177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85be6a-4143-470c-bf7b-f602d0a10083 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:54.391041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85be6a-4143-470c-bf7b-f602d0a10083 admin admin] PATH_INFO: `/v3/projects/cbc2ac6533a54ac6b80c2a9baf2826bc/users/c82c7a049db145f89aed9044403d567c/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:54.451996 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85be6a-4143-470c-bf7b-f602d0a10083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc2ac6533a54ac6b80c2a9baf2826bc, user_id=c82c7a049db145f89aed9044403d567c, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:54.456687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85be6a-4143-470c-bf7b-f602d0a10083 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:54.578090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef302ce-23dd-4ff6-ab70-ef8544b314c2 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:54.605097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 844/1691] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:54 2022] PUT /identity/v3/projects/cbc2ac6533a54ac6b80c2a9baf2826bc/users/c82c7a049db145f89aed9044403d567c/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:54.606507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85be6a-4143-470c-bf7b-f602d0a10083 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:54.611450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9c85be6a-4143-470c-bf7b-f602d0a10083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:54.615479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ae668-ac01-4366-9563-e155f6c2fd48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:54.621920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ae668-ac01-4366-9563-e155f6c2fd48 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:54.623670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ae668-ac01-4366-9563-e155f6c2fd48 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:54.624139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ae668-ac01-4366-9563-e155f6c2fd48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:54.672195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ae668-ac01-4366-9563-e155f6c2fd48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:54.680348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ae668-ac01-4366-9563-e155f6c2fd48 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:54.725993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 848/1692] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:54.732962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2feb9-3bd2-4338-abdf-2b59427e8392 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:54.734121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2feb9-3bd2-4338-abdf-2b59427e8392 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:54.734121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2feb9-3bd2-4338-abdf-2b59427e8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:54.791347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-57b2feb9-3bd2-4338-abdf-2b59427e8392 None None] MFA Rules not processed for user `c82c7a049db145f89aed9044403d567c`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:54.794206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-57b2feb9-3bd2-4338-abdf-2b59427e8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:54.838957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85be6a-4143-470c-bf7b-f602d0a10083 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:54.855318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:54.855909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:54.856198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:54.856479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] PATH_INFO: `/v3/users/0aaf0941153a421ca401cf398e8042ff` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:54.859834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aaf0941153a421ca401cf398e8042ff)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:54.864636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:54.987036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 849/1693] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:54.994372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2feb9-3bd2-4338-abdf-2b59427e8392 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:55.029368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2feb9-3bd2-4338-abdf-2b59427e8392 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:55.038915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7a3ad-024c-48fb-a938-b38734c2a10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:55.042636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7a3ad-024c-48fb-a938-b38734c2a10a admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.042925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7a3ad-024c-48fb-a938-b38734c2a10a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.043198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7a3ad-024c-48fb-a938-b38734c2a10a admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.045071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7a3ad-024c-48fb-a938-b38734c2a10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:55.076421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7a3ad-024c-48fb-a938-b38734c2a10a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:55.142048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aaf0941153a421ca401cf398e8042ff'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:55.144564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aaf0941153a421ca401cf398e8042ff'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:55.145521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aaf0941153a421ca401cf398e8042ff'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:55.207794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 850/1694] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:54 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:55.212733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7a3ad-024c-48fb-a938-b38734c2a10a admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:55.215254 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c4f7a3ad-024c-48fb-a938-b38734c2a10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:55.224076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aaf0941153a421ca401cf398e8042ff'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:55.269344 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-db7b55aa-f600-4fce-9205-b66030d10e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aaf0941153a421ca401cf398e8042ff'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:55.332252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 845/1695] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:54:54 2022] DELETE /identity/v3/users/0aaf0941153a421ca401cf398e8042ff => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:55.333390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7a3ad-024c-48fb-a938-b38734c2a10a admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:55.337106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1afee-f199-49a8-a719-ecccc39ad823 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.344535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1afee-f199-49a8-a719-ecccc39ad823 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.344896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1afee-f199-49a8-a719-ecccc39ad823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.395774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d8e1afee-f199-49a8-a719-ecccc39ad823 None None] MFA Rules not processed for user `440c70c023534045b2d6a095db05302d`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:55.398844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d8e1afee-f199-49a8-a719-ecccc39ad823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:55.459531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf07cd-81b4-4beb-979a-c61f595ff12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:55.462339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf07cd-81b4-4beb-979a-c61f595ff12d admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.462339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf07cd-81b4-4beb-979a-c61f595ff12d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.462339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf07cd-81b4-4beb-979a-c61f595ff12d admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.462585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf07cd-81b4-4beb-979a-c61f595ff12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:55.466918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf07cd-81b4-4beb-979a-c61f595ff12d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:55.545780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 846/1696] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:55.547261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2a136-541b-48c0-8711-d3e29e9ea97d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.547701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2a136-541b-48c0-8711-d3e29e9ea97d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.548008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2a136-541b-48c0-8711-d3e29e9ea97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.571133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-9cb2a136-541b-48c0-8711-d3e29e9ea97d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:55.572592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9cb2a136-541b-48c0-8711-d3e29e9ea97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:55.587612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 851/1697] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:55 2022] POST /identity/v3/users => generated 298 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:54:55.587612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2386706-b215-4257-b205-1386ec59f071 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.587612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2386706-b215-4257-b205-1386ec59f071 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.587914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2386706-b215-4257-b205-1386ec59f071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.600656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 847/1698] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:55.601965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2a136-541b-48c0-8711-d3e29e9ea97d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:55.620610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2a136-541b-48c0-8711-d3e29e9ea97d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:55.625491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c2386706-b215-4257-b205-1386ec59f071 None None] MFA Rules not processed for user `440c70c023534045b2d6a095db05302d`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:55.627810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c2386706-b215-4257-b205-1386ec59f071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:55.635027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede87d-412f-4ee8-aa4f-8543dc07c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:55.635772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede87d-412f-4ee8-aa4f-8543dc07c831 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.636127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede87d-412f-4ee8-aa4f-8543dc07c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.636485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede87d-412f-4ee8-aa4f-8543dc07c831 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.637302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede87d-412f-4ee8-aa4f-8543dc07c831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:55.642220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede87d-412f-4ee8-aa4f-8543dc07c831 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:55.646601 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 852/1699] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:55.661168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2386706-b215-4257-b205-1386ec59f071 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:55.664923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c2386706-b215-4257-b205-1386ec59f071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:55.682532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 848/1700] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:55.686057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede87d-412f-4ee8-aa4f-8543dc07c831 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:55.698408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d1ede87d-412f-4ee8-aa4f-8543dc07c831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:55.828645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2386706-b215-4257-b205-1386ec59f071 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:55.837529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574c74a-6a55-4410-8ce5-48d2ed260479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:55.839467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574c74a-6a55-4410-8ce5-48d2ed260479 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.839758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574c74a-6a55-4410-8ce5-48d2ed260479 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.840033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574c74a-6a55-4410-8ce5-48d2ed260479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.856741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574c74a-6a55-4410-8ce5-48d2ed260479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:55.861305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574c74a-6a55-4410-8ce5-48d2ed260479 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:55.865052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede87d-412f-4ee8-aa4f-8543dc07c831 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:55.873985 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 853/1701] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:55.874249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb76b9e-7c51-4ceb-88b8-f49914d3eb9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:55.875322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb76b9e-7c51-4ceb-88b8-f49914d3eb9d service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.875574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574c74a-6a55-4410-8ce5-48d2ed260479 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:55.876021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb76b9e-7c51-4ceb-88b8-f49914d3eb9d service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.876486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb76b9e-7c51-4ceb-88b8-f49914d3eb9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.896655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb76b9e-7c51-4ceb-88b8-f49914d3eb9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:55.899555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb76b9e-7c51-4ceb-88b8-f49914d3eb9d service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:55.902140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574c74a-6a55-4410-8ce5-48d2ed260479 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:55.912088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c33f25-3145-433d-a766-8e80cb9411be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:55.915549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c33f25-3145-433d-a766-8e80cb9411be admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.915836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 849/1702] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:55.915924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c33f25-3145-433d-a766-8e80cb9411be admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.915924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c33f25-3145-433d-a766-8e80cb9411be admin admin] PATH_INFO: `/v3/projects/9f306c6079f54b1bb4b2c1837237619a/users/a6c3f86bec3b4945971fab9439e69590/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.916071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c82b-d971-4590-b422-ce9de6f35d89 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.929798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c82b-d971-4590-b422-ce9de6f35d89 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.931490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c82b-d971-4590-b422-ce9de6f35d89 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.934295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 850/1703] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 24 07:54:55 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:55.941146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3eee-4343-4f1e-9dbc-68d34b980ec3 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.941500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3eee-4343-4f1e-9dbc-68d34b980ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.941766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3eee-4343-4f1e-9dbc-68d34b980ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.954595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c33f25-3145-433d-a766-8e80cb9411be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f306c6079f54b1bb4b2c1837237619a, user_id=a6c3f86bec3b4945971fab9439e69590, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:55.957036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c33f25-3145-433d-a766-8e80cb9411be admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:56.050207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-837f3eee-4343-4f1e-9dbc-68d34b980ec3 None None] MFA Rules not processed for user `a4403ef0835a4d658f8eb50fac0780eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:56.053171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-837f3eee-4343-4f1e-9dbc-68d34b980ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:56.070238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 851/1704] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:54:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:56.081682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 854/1705] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:55 2022] PUT /identity/v3/projects/9f306c6079f54b1bb4b2c1837237619a/users/a6c3f86bec3b4945971fab9439e69590/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:56.098530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f3eee-4343-4f1e-9dbc-68d34b980ec3 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:56.110922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c33f25-3145-433d-a766-8e80cb9411be admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:56.116323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-20c33f25-3145-433d-a766-8e80cb9411be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:56.141513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f3eee-4343-4f1e-9dbc-68d34b980ec3 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:56.257968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:56.329890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c33f25-3145-433d-a766-8e80cb9411be admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:56.340859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf5304-3075-42cc-ab14-ac6c9e97b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:56.344634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf5304-3075-42cc-ab14-ac6c9e97b637 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:56.345212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf5304-3075-42cc-ab14-ac6c9e97b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:56.345663 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf5304-3075-42cc-ab14-ac6c9e97b637 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:56.346455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c242d4-2676-4d54-a02f-a52467674ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:56.346951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf5304-3075-42cc-ab14-ac6c9e97b637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:56.347167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c242d4-2676-4d54-a02f-a52467674ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:56.347954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c242d4-2676-4d54-a02f-a52467674ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:56.348238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c242d4-2676-4d54-a02f-a52467674ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:56.352590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf5304-3075-42cc-ab14-ac6c9e97b637 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:56.366054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c242d4-2676-4d54-a02f-a52467674ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:56.371375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c242d4-2676-4d54-a02f-a52467674ce4 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:56.394058 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 852/1706] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:56.394240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 855/1707] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:54:56.395022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c242d4-2676-4d54-a02f-a52467674ce4 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:56.461553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c242d4-2676-4d54-a02f-a52467674ce4 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:56.485694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdee81c-34d8-4549-a65e-daa37c3da321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:56.485694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdee81c-34d8-4549-a65e-daa37c3da321 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:56.485694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdee81c-34d8-4549-a65e-daa37c3da321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:56.485694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdee81c-34d8-4549-a65e-daa37c3da321 admin admin] PATH_INFO: `/v3/projects/9f306c6079f54b1bb4b2c1837237619a/users/a6c3f86bec3b4945971fab9439e69590/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:56.493654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdee81c-34d8-4549-a65e-daa37c3da321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f306c6079f54b1bb4b2c1837237619a, user_id=a6c3f86bec3b4945971fab9439e69590, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:56.510095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdee81c-34d8-4549-a65e-daa37c3da321 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:56.542299 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 856/1708] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:54:56 2022] PUT /identity/v3/projects/9f306c6079f54b1bb4b2c1837237619a/users/a6c3f86bec3b4945971fab9439e69590/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:56.552562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97758-a3ba-4cb3-bcc9-391a58e4f53e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:56.553026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97758-a3ba-4cb3-bcc9-391a58e4f53e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:56.553470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97758-a3ba-4cb3-bcc9-391a58e4f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:56.607595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:56.609103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-9bd97758-a3ba-4cb3-bcc9-391a58e4f53e None None] MFA Rules not processed for user `a6c3f86bec3b4945971fab9439e69590`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:56.610383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9bd97758-a3ba-4cb3-bcc9-391a58e4f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:56.886616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 853/1709] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:56.970125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdee81c-34d8-4549-a65e-daa37c3da321 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:56.972201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8fdee81c-34d8-4549-a65e-daa37c3da321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:57.099512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c508f-17ea-4b46-b088-6afbfea7565d None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:57.099830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c508f-17ea-4b46-b088-6afbfea7565d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:57.100078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c508f-17ea-4b46-b088-6afbfea7565d None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:57.101128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdee81c-34d8-4549-a65e-daa37c3da321 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:57.107641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 854/1710] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 24 07:54:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:54:57.111263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaba83-6c1e-4e34-96c8-bab20e995632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:57.111983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaba83-6c1e-4e34-96c8-bab20e995632 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:57.112691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaba83-6c1e-4e34-96c8-bab20e995632 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:57.113120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbaba83-6c1e-4e34-96c8-bab20e995632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:57.127325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dfda7-c67f-497d-8362-ae80f902a7e1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:57.127607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dfda7-c67f-497d-8362-ae80f902a7e1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:57.127884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dfda7-c67f-497d-8362-ae80f902a7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:57.139635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbaba83-6c1e-4e34-96c8-bab20e995632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:57.141589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbaba83-6c1e-4e34-96c8-bab20e995632 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:57.179901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 857/1711] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:57.181147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaba83-6c1e-4e34-96c8-bab20e995632 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:57.182738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-622dfda7-c67f-497d-8362-ae80f902a7e1 None None] MFA Rules not processed for user `a4403ef0835a4d658f8eb50fac0780eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:57.184102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-622dfda7-c67f-497d-8362-ae80f902a7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:57.188426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-fdbaba83-6c1e-4e34-96c8-bab20e995632 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:57.362811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 855/1712] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:54:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:54:57.378565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dfda7-c67f-497d-8362-ae80f902a7e1 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:57.395330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dfda7-c67f-497d-8362-ae80f902a7e1 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:57.396734 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbaba83-6c1e-4e34-96c8-bab20e995632 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:57.408625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825365d-a877-49ec-96f2-4994a2e290c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:57.410019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825365d-a877-49ec-96f2-4994a2e290c5 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:57.410635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825365d-a877-49ec-96f2-4994a2e290c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:57.411100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825365d-a877-49ec-96f2-4994a2e290c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:57.424700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825365d-a877-49ec-96f2-4994a2e290c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:57.424978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:57.425743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:57.426115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:57.426496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] PATH_INFO: `/v3/projects/0e0a106dc6294aa889940838bd57c92c` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:57.428784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825365d-a877-49ec-96f2-4994a2e290c5 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:57.429357 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0a106dc6294aa889940838bd57c92c)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:57.431437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:57.456555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 856/1713] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:54:57.623680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0a106dc6294aa889940838bd57c92c', 'request_id': 'req-88cd12a0-4a6a-44c8-9359-c88b21a9f010'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:57.652161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825365d-a877-49ec-96f2-4994a2e290c5 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:57.653803 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6825365d-a877-49ec-96f2-4994a2e290c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:57.711039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825365d-a877-49ec-96f2-4994a2e290c5 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:57.755580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0a106dc6294aa889940838bd57c92c', 'request_id': 'req-88cd12a0-4a6a-44c8-9359-c88b21a9f010'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:57.766897 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0a106dc6294aa889940838bd57c92c', 'request_id': 'req-88cd12a0-4a6a-44c8-9359-c88b21a9f010'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:57.817181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] The token cache is being invalidate because project 0e0a106dc6294aa889940838bd57c92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:54:57.817406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:57.818837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-88cd12a0-4a6a-44c8-9359-c88b21a9f010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:57.824007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 858/1714] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:54:57 2022] DELETE /identity/v3/projects/0e0a106dc6294aa889940838bd57c92c => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:57.828646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44318c-90c6-418a-a25a-289c59794ad6 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:57.829127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44318c-90c6-418a-a25a-289c59794ad6 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:57.829587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44318c-90c6-418a-a25a-289c59794ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:57.878656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-1d44318c-90c6-418a-a25a-289c59794ad6 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:57.880779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1d44318c-90c6-418a-a25a-289c59794ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:57.934064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae36a74-97b5-4675-b01a-75f99cb10dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:57.934727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae36a74-97b5-4675-b01a-75f99cb10dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:57.934979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae36a74-97b5-4675-b01a-75f99cb10dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:57.935263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae36a74-97b5-4675-b01a-75f99cb10dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:57.938906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-eae36a74-97b5-4675-b01a-75f99cb10dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:57.998850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 859/1715] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:54:58.001336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8b4ce-dc06-41a8-b44a-98648c8ad0a5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.001634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8b4ce-dc06-41a8-b44a-98648c8ad0a5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.002211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8b4ce-dc06-41a8-b44a-98648c8ad0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:58.033984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a1f8b4ce-dc06-41a8-b44a-98648c8ad0a5 None None] MFA Rules not processed for user `e618ac2e8e884988b42a1d8b195eb457`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:58.036368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a1f8b4ce-dc06-41a8-b44a-98648c8ad0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.111265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae36a74-97b5-4675-b01a-75f99cb10dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:58.112945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae36a74-97b5-4675-b01a-75f99cb10dd3 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:58.133468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 857/1716] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:54:58.146899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7c304-c476-43a8-8994-33be69601ebb None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.146899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7c304-c476-43a8-8994-33be69601ebb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.146899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7c304-c476-43a8-8994-33be69601ebb None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:58.146899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 858/1717] 10.222.0.17 () {54 vars in 961 bytes} [Wed Aug 24 07:54:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:58.150498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a30dd-2946-464d-b63c-73a17534e002 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.150783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a30dd-2946-464d-b63c-73a17534e002 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.151067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a30dd-2946-464d-b63c-73a17534e002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:58.157050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 860/1718] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:58.158450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8b4ce-dc06-41a8-b44a-98648c8ad0a5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:58.160823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a1f8b4ce-dc06-41a8-b44a-98648c8ad0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.165651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:58.188435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8b4ce-dc06-41a8-b44a-98648c8ad0a5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:58.200199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:58.200882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.201137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.201414 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] PATH_INFO: `/v3/users/89db202162fc49a6bb184dafcbf2c683` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:58.202644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89db202162fc49a6bb184dafcbf2c683)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:58.209697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:58.217784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-200a30dd-2946-464d-b63c-73a17534e002 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:58.219858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-200a30dd-2946-464d-b63c-73a17534e002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.244420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 859/1719] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:58.247832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce5e3-14b4-4823-9f17-55f145bff6f0 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.248294 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce5e3-14b4-4823-9f17-55f145bff6f0 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.253641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce5e3-14b4-4823-9f17-55f145bff6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:58.291060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ebcce5e3-14b4-4823-9f17-55f145bff6f0 None None] MFA Rules not processed for user `36bd5aef3c034c41be036c4cc9eed376`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:58.292491 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ebcce5e3-14b4-4823-9f17-55f145bff6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.471166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89db202162fc49a6bb184dafcbf2c683'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:58.473153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89db202162fc49a6bb184dafcbf2c683'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:58.474520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89db202162fc49a6bb184dafcbf2c683'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:58.516183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:58.536682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89db202162fc49a6bb184dafcbf2c683'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:58.563774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 860/1720] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Aug 24 07:54:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:58.564720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce5e3-14b4-4823-9f17-55f145bff6f0 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:58.566195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ebcce5e3-14b4-4823-9f17-55f145bff6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.606598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce5e3-14b4-4823-9f17-55f145bff6f0 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:58.627193 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:58.627878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.628162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.628435 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:58.629090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:58.629399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:58.631024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:58.673020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89db202162fc49a6bb184dafcbf2c683'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:58.676822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 861/1721] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:58.678770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:58.696009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.711967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 861/1722] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:54:58 2022] DELETE /identity/v3/users/89db202162fc49a6bb184dafcbf2c683 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:58.715219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:58.764753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb33066-fa98-4fee-bd12-2a564a59ad22 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:58.956667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ef3f0-6056-41c1-9ecf-684d2ac1349b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:58.966114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a4c29-bcb7-456e-9750-129504ad4291 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:58.966745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a4c29-bcb7-456e-9750-129504ad4291 service placement] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.967030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a4c29-bcb7-456e-9750-129504ad4291 service placement] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.967362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a4c29-bcb7-456e-9750-129504ad4291 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:58.973566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d00a4c29-bcb7-456e-9750-129504ad4291 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.979881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e362b79-70b8-47f2-90ad-56bec398719c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:58.981272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e362b79-70b8-47f2-90ad-56bec398719c service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.981272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e362b79-70b8-47f2-90ad-56bec398719c service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.981272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e362b79-70b8-47f2-90ad-56bec398719c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:59.008914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e362b79-70b8-47f2-90ad-56bec398719c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:59.010878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e362b79-70b8-47f2-90ad-56bec398719c service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:59.012713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a4c29-bcb7-456e-9750-129504ad4291 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:59.014307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a4c29-bcb7-456e-9750-129504ad4291 service placement] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:59.043037 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 862/1723] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:59.044454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e362b79-70b8-47f2-90ad-56bec398719c service placement] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:59.049788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 862/1724] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:59.054940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59806ed8-7e32-48e8-81b5-00343da6ede6 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:59.055347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59806ed8-7e32-48e8-81b5-00343da6ede6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:59.055703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59806ed8-7e32-48e8-81b5-00343da6ede6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:59.084491 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-59806ed8-7e32-48e8-81b5-00343da6ede6 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:59.086504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-59806ed8-7e32-48e8-81b5-00343da6ede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:59.096441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:59.203854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e362b79-70b8-47f2-90ad-56bec398719c service placement] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:59.209227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47404c6d-7b09-4fc3-b479-2460fcc235e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:59.209908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47404c6d-7b09-4fc3-b479-2460fcc235e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:59.210353 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47404c6d-7b09-4fc3-b479-2460fcc235e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:59.211215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47404c6d-7b09-4fc3-b479-2460fcc235e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:59.212129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47404c6d-7b09-4fc3-b479-2460fcc235e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:59.214364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47404c6d-7b09-4fc3-b479-2460fcc235e6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:59.282901 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 863/1725] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:59.287308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87112ff-0f3b-49fa-928b-7a096cf52eef None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:59.287308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87112ff-0f3b-49fa-928b-7a096cf52eef None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:59.287308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87112ff-0f3b-49fa-928b-7a096cf52eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:59.314903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 863/1726] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:54:59 2022] POST /identity/v3/projects => generated 403 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:59.316804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47404c6d-7b09-4fc3-b479-2460fcc235e6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:59.320584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-47404c6d-7b09-4fc3-b479-2460fcc235e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:59.374719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d87112ff-0f3b-49fa-928b-7a096cf52eef None None] MFA Rules not processed for user `440c70c023534045b2d6a095db05302d`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:59.375969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d87112ff-0f3b-49fa-928b-7a096cf52eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:59.511829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47404c6d-7b09-4fc3-b479-2460fcc235e6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:59.517702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 864/1727] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:54:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:59.520735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87112ff-0f3b-49fa-928b-7a096cf52eef None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:59.522611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d87112ff-0f3b-49fa-928b-7a096cf52eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:59.528269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:59.528628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:59.529001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:59.529374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] PATH_INFO: `/v3/users/b7238e7c8a9e4e22bb047bad10856218` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:59.532578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7238e7c8a9e4e22bb047bad10856218)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:59.540206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:59.654497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87112ff-0f3b-49fa-928b-7a096cf52eef None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:59.662494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2737d9-5afa-497a-8a02-99a29638f0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:59.663240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2737d9-5afa-497a-8a02-99a29638f0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:59.663574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2737d9-5afa-497a-8a02-99a29638f0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:59.663854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2737d9-5afa-497a-8a02-99a29638f0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:59.684614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2737d9-5afa-497a-8a02-99a29638f0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:59.686083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2737d9-5afa-497a-8a02-99a29638f0b6 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:59.747777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 865/1728] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:59.749816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2737d9-5afa-497a-8a02-99a29638f0b6 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:59.752224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8e2737d9-5afa-497a-8a02-99a29638f0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:59.767679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2737d9-5afa-497a-8a02-99a29638f0b6 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:59.774405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:59.775253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:59.779388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:59.779388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] PATH_INFO: `/v3/users/c82c7a049db145f89aed9044403d567c` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:59.779388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82c7a049db145f89aed9044403d567c)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:59.780178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:59.841913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7238e7c8a9e4e22bb047bad10856218'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:59.842890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7238e7c8a9e4e22bb047bad10856218'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:59.843553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7238e7c8a9e4e22bb047bad10856218'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:59.858867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7238e7c8a9e4e22bb047bad10856218'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:59.936421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7238e7c8a9e4e22bb047bad10856218'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:54:59.986920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 864/1729] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:54:59 2022] DELETE /identity/v3/users/b7238e7c8a9e4e22bb047bad10856218 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:59.987864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:59.990815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:00.016592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:00.067084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82c7a049db145f89aed9044403d567c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:00.068655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82c7a049db145f89aed9044403d567c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:00.069595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82c7a049db145f89aed9044403d567c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:00.098778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1d267-13ea-49e8-9f72-8d7bb0fd674e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:00.105430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d577f09-056b-4f77-b045-0865d529ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:00.106499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d577f09-056b-4f77-b045-0865d529ffda admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:00.107393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d577f09-056b-4f77-b045-0865d529ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:00.107867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d577f09-056b-4f77-b045-0865d529ffda admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:00.108632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d577f09-056b-4f77-b045-0865d529ffda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:00.111066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d577f09-056b-4f77-b045-0865d529ffda admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:00.182092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82c7a049db145f89aed9044403d567c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:00.197059 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 865/1730] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:59 2022] POST /identity/v3/users => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:00.198371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a960-d619-4edd-87fe-13b054e3f799 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:00.198656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a960-d619-4edd-87fe-13b054e3f799 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:00.198929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a960-d619-4edd-87fe-13b054e3f799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:00.206343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82c7a049db145f89aed9044403d567c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:00.233069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d609a960-d619-4edd-87fe-13b054e3f799 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:00.234319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d609a960-d619-4edd-87fe-13b054e3f799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:00.234651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 866/1731] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:54:59 2022] DELETE /identity/v3/users/c82c7a049db145f89aed9044403d567c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:00.240753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:00.247196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:00.277425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:00.514899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64287aed-21c6-4715-bb38-5e9520b4fa2d admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:00.525529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 866/1732] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:00.525529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816677-1b20-4cc0-9a5f-1e335dc0aea1 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:00.527565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816677-1b20-4cc0-9a5f-1e335dc0aea1 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:00.528113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816677-1b20-4cc0-9a5f-1e335dc0aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:00.539154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330da7ed-6b0d-4563-8e5f-c0647ace5897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:00.543722 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330da7ed-6b0d-4563-8e5f-c0647ace5897 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:00.544075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330da7ed-6b0d-4563-8e5f-c0647ace5897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:00.544693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330da7ed-6b0d-4563-8e5f-c0647ace5897 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:00.546788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330da7ed-6b0d-4563-8e5f-c0647ace5897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:00.549002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330da7ed-6b0d-4563-8e5f-c0647ace5897 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:00.567464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-4f816677-1b20-4cc0-9a5f-1e335dc0aea1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:00.570715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4f816677-1b20-4cc0-9a5f-1e335dc0aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:00.589650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 867/1733] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:00.591472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330da7ed-6b0d-4563-8e5f-c0647ace5897 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:00.606348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-330da7ed-6b0d-4563-8e5f-c0647ace5897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:00.609434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 867/1734] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:00.610435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816677-1b20-4cc0-9a5f-1e335dc0aea1 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:00.622122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816677-1b20-4cc0-9a5f-1e335dc0aea1 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:00.635132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e261bd-70e1-4b57-917e-4ff697a7405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:00.635815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e261bd-70e1-4b57-917e-4ff697a7405b admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:00.636094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e261bd-70e1-4b57-917e-4ff697a7405b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:00.636551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e261bd-70e1-4b57-917e-4ff697a7405b admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:00.638023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e261bd-70e1-4b57-917e-4ff697a7405b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:00.640212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e261bd-70e1-4b57-917e-4ff697a7405b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:00.663802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 868/1735] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:00.664791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e261bd-70e1-4b57-917e-4ff697a7405b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:00.671593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d8e261bd-70e1-4b57-917e-4ff697a7405b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:00.794043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330da7ed-6b0d-4563-8e5f-c0647ace5897 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:00.804085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c2765-40ad-4525-992f-914c5e2dbd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:00.806240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c2765-40ad-4525-992f-914c5e2dbd30 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:00.806768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c2765-40ad-4525-992f-914c5e2dbd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:00.808605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c2765-40ad-4525-992f-914c5e2dbd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:00.812230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e261bd-70e1-4b57-917e-4ff697a7405b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:00.818944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eadd12-2805-4705-82d3-30b377b0643b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:00.819978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eadd12-2805-4705-82d3-30b377b0643b service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:00.820416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eadd12-2805-4705-82d3-30b377b0643b service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:00.820944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eadd12-2805-4705-82d3-30b377b0643b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:00.832300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c2765-40ad-4525-992f-914c5e2dbd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:00.836041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c2765-40ad-4525-992f-914c5e2dbd30 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:00.869523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eadd12-2805-4705-82d3-30b377b0643b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:00.871005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eadd12-2805-4705-82d3-30b377b0643b service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:00.872089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 868/1736] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:00.877240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c2765-40ad-4525-992f-914c5e2dbd30 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:00.910323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c2765-40ad-4525-992f-914c5e2dbd30 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:00.924025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4439ee-d5a3-43e8-8002-8028d60c1e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:00.927345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4439ee-d5a3-43e8-8002-8028d60c1e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:00.927700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4439ee-d5a3-43e8-8002-8028d60c1e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:00.928042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4439ee-d5a3-43e8-8002-8028d60c1e46 admin admin] PATH_INFO: `/v3/projects/1f978fa2d7a74a23bf947566be5a5a48/users/de6bb3407c624210912f6e283a9e617b/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:00.948728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 869/1737] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:00.955346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eadd12-2805-4705-82d3-30b377b0643b service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:00.965114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:00.966301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-12eadd12-2805-4705-82d3-30b377b0643b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:01.063036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eadd12-2805-4705-82d3-30b377b0643b service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:01.078034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4439ee-d5a3-43e8-8002-8028d60c1e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f978fa2d7a74a23bf947566be5a5a48, user_id=de6bb3407c624210912f6e283a9e617b, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:01.095052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4439ee-d5a3-43e8-8002-8028d60c1e46 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:01.105584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:01.106243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:01.106524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:01.114787 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] PATH_INFO: `/v3/projects/b81bab6b4e434568a69f4bc62b90beba` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:01.134124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81bab6b4e434568a69f4bc62b90beba)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:01.138106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:01.226035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 869/1738] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:00 2022] PUT /identity/v3/projects/1f978fa2d7a74a23bf947566be5a5a48/users/de6bb3407c624210912f6e283a9e617b/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:01.227631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab4ced-ad32-4068-b58a-581618ad468a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:01.229224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab4ced-ad32-4068-b58a-581618ad468a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:01.229532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab4ced-ad32-4068-b58a-581618ad468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:01.311255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-70ab4ced-ad32-4068-b58a-581618ad468a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:01.315495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-70ab4ced-ad32-4068-b58a-581618ad468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:01.576770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81bab6b4e434568a69f4bc62b90beba', 'request_id': 'req-6af56cd3-c47a-43f4-b459-16359bf959a7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:01.629190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 870/1739] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:01.645420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:01.686597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81bab6b4e434568a69f4bc62b90beba', 'request_id': 'req-6af56cd3-c47a-43f4-b459-16359bf959a7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:01.691090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab4ced-ad32-4068-b58a-581618ad468a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:01.695015 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81bab6b4e434568a69f4bc62b90beba', 'request_id': 'req-6af56cd3-c47a-43f4-b459-16359bf959a7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:01.731928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] The token cache is being invalidate because project b81bab6b4e434568a69f4bc62b90beba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:01.732285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:01.740149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:01.744116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 870/1740] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:00 2022] DELETE /identity/v3/projects/b81bab6b4e434568a69f4bc62b90beba => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:01.748685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:01.752512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:01.846578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab4ced-ad32-4068-b58a-581618ad468a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:01.956704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af56cd3-c47a-43f4-b459-16359bf959a7 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:01.976382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:01.977429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:01.977884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:01.978377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:01.978981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:01.979780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:01.980104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:01.980328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] PATH_INFO: `/v3/users/f3ab03d0154248a292fc103b94f5b452` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:01.981593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ab03d0154248a292fc103b94f5b452)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:01.982022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:01.983785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:02.017436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:02.021056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:02.060712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 871/1741] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:02.144869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:02.146856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:02.177699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940fc85-f142-4a7c-b8e4-26ec0a24e87c service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:02.183325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:02.184812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:02.185097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:02.185427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] PATH_INFO: `/v3/projects/855050dd718a49fcb847501c3393a6d5` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:02.188336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855050dd718a49fcb847501c3393a6d5)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:02.191384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:02.197198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:02.252313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ab03d0154248a292fc103b94f5b452'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.255936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ab03d0154248a292fc103b94f5b452'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.258533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ab03d0154248a292fc103b94f5b452'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.277638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ab03d0154248a292fc103b94f5b452'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.418923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855050dd718a49fcb847501c3393a6d5', 'request_id': 'req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.432720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ab03d0154248a292fc103b94f5b452'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.446493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855050dd718a49fcb847501c3393a6d5', 'request_id': 'req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.461546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 871/1742] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:01 2022] DELETE /identity/v3/users/f3ab03d0154248a292fc103b94f5b452 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:02.463021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:02.464777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:02.527744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855050dd718a49fcb847501c3393a6d5', 'request_id': 'req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.546619 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] The token cache is being invalidate because project 855050dd718a49fcb847501c3393a6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:02.547279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.548678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.550851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 872/1743] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:02 2022] DELETE /identity/v3/projects/855050dd718a49fcb847501c3393a6d5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:02.566611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:02.568595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:02.619366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07539-8f0d-4c22-9801-c4f47aa4a1a4 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:02.630688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:02.632363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:02.633786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:02.634326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] PATH_INFO: `/v3/projects/cbc2ac6533a54ac6b80c2a9baf2826bc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:02.636851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc2ac6533a54ac6b80c2a9baf2826bc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:02.669443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:02.892547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc2ac6533a54ac6b80c2a9baf2826bc', 'request_id': 'req-abb052a7-4925-467e-9405-3a5459ce5962'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:02.897224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d47e0-dc2d-4c06-94d9-4f9d9dc38125 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:03.016892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc2ac6533a54ac6b80c2a9baf2826bc', 'request_id': 'req-abb052a7-4925-467e-9405-3a5459ce5962'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.028422 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc2ac6533a54ac6b80c2a9baf2826bc', 'request_id': 'req-abb052a7-4925-467e-9405-3a5459ce5962'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.067938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] The token cache is being invalidate because project cbc2ac6533a54ac6b80c2a9baf2826bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:03.068228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.073538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.075498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 872/1744] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:02 2022] DELETE /identity/v3/projects/cbc2ac6533a54ac6b80c2a9baf2826bc => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:03.080342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:03.082665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:03.086665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:03.087358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:03.087642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:03.090812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] PATH_INFO: `/v3/users/ae61bc9f60c7460d9c355755c1eed23c` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:03.094916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae61bc9f60c7460d9c355755c1eed23c)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:03.102639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:03.106192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb052a7-4925-467e-9405-3a5459ce5962 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:03.117212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:03.118933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:03.119482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:03.120186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] PATH_INFO: `/v3/users/a6c3f86bec3b4945971fab9439e69590` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:03.125065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c3f86bec3b4945971fab9439e69590)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:03.127970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:03.375704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae61bc9f60c7460d9c355755c1eed23c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.376787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae61bc9f60c7460d9c355755c1eed23c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.377686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae61bc9f60c7460d9c355755c1eed23c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.409597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c3f86bec3b4945971fab9439e69590'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.410954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c3f86bec3b4945971fab9439e69590'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.415663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c3f86bec3b4945971fab9439e69590'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.447120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c3f86bec3b4945971fab9439e69590'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.479683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae61bc9f60c7460d9c355755c1eed23c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.503060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae61bc9f60c7460d9c355755c1eed23c'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.524067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 873/1745] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:02 2022] DELETE /identity/v3/users/ae61bc9f60c7460d9c355755c1eed23c => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:03.565280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-af86ad2f-ddc7-4588-b4d2-ee584b5fe4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c3f86bec3b4945971fab9439e69590'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:03.580410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 873/1746] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:03 2022] DELETE /identity/v3/users/a6c3f86bec3b4945971fab9439e69590 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:03.606786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:03.642353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:03.643971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:03.789813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d0682-0842-45ce-8a83-523c6a754619 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:03.940825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:03.942231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:03.942708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:03.944186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] PATH_INFO: `/v3/projects/7bff8b366ac444ef8e5da871638e7345` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:03.946672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bff8b366ac444ef8e5da871638e7345)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:03.949026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:04.119812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bff8b366ac444ef8e5da871638e7345', 'request_id': 'req-0995dfec-ebc8-4024-a3da-913503033174'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.132163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bff8b366ac444ef8e5da871638e7345', 'request_id': 'req-0995dfec-ebc8-4024-a3da-913503033174'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.267638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bff8b366ac444ef8e5da871638e7345', 'request_id': 'req-0995dfec-ebc8-4024-a3da-913503033174'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.290082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] The token cache is being invalidate because project 7bff8b366ac444ef8e5da871638e7345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:04.290478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.292142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0995dfec-ebc8-4024-a3da-913503033174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.299450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 874/1747] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:03 2022] DELETE /identity/v3/projects/7bff8b366ac444ef8e5da871638e7345 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:04.301781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49a29a-6909-4730-9d2a-e2adf767a2fa None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:04.305139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49a29a-6909-4730-9d2a-e2adf767a2fa None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:04.305139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49a29a-6909-4730-9d2a-e2adf767a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:04.324972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:04.346092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-aa49a29a-6909-4730-9d2a-e2adf767a2fa None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:04.347412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-aa49a29a-6909-4730-9d2a-e2adf767a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:04.492489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 874/1748] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:04.503435 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36248e-2e98-4b2a-8eb1-b92dcf467bf8 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:04.503895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36248e-2e98-4b2a-8eb1-b92dcf467bf8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:04.504318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36248e-2e98-4b2a-8eb1-b92dcf467bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:04.532111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-bf36248e-2e98-4b2a-8eb1-b92dcf467bf8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:04.534410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bf36248e-2e98-4b2a-8eb1-b92dcf467bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:04.550141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 875/1749] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:04.550879 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49a29a-6909-4730-9d2a-e2adf767a2fa None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:04.561724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49a29a-6909-4730-9d2a-e2adf767a2fa None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:04.568056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:04.569132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:04.569677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:04.570475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:04.571830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:04.572470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:04.574235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:04.586955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 875/1750] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:55:04.591347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36248e-2e98-4b2a-8eb1-b92dcf467bf8 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:04.604193 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36248e-2e98-4b2a-8eb1-b92dcf467bf8 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:04.613197 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde47004-c42f-4b40-adac-fed61553bca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:04.614004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde47004-c42f-4b40-adac-fed61553bca6 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:04.614348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde47004-c42f-4b40-adac-fed61553bca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:04.614675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde47004-c42f-4b40-adac-fed61553bca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:04.615386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde47004-c42f-4b40-adac-fed61553bca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:04.617898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde47004-c42f-4b40-adac-fed61553bca6 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:04.641176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:04.643551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:04.665471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcb729-1eea-4c81-96db-87a2df728286 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:04.672159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:04.672816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:04.673102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:04.673427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] PATH_INFO: `/v3/projects/679b7ccf3b0349b5afeb9bd4e3ac74ae` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:04.674850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679b7ccf3b0349b5afeb9bd4e3ac74ae)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:04.676814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:04.741300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 876/1751] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:04 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:04.742308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde47004-c42f-4b40-adac-fed61553bca6 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:04.747637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bde47004-c42f-4b40-adac-fed61553bca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:04.793289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679b7ccf3b0349b5afeb9bd4e3ac74ae', 'request_id': 'req-19f9d77e-aaae-49fa-94b1-eb64f501b284'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.892073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679b7ccf3b0349b5afeb9bd4e3ac74ae', 'request_id': 'req-19f9d77e-aaae-49fa-94b1-eb64f501b284'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.901765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679b7ccf3b0349b5afeb9bd4e3ac74ae', 'request_id': 'req-19f9d77e-aaae-49fa-94b1-eb64f501b284'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.932986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde47004-c42f-4b40-adac-fed61553bca6 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:04.945989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] The token cache is being invalidate because project 679b7ccf3b0349b5afeb9bd4e3ac74ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:04.959446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.963487 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:04.973124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 876/1752] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:04 2022] DELETE /identity/v3/projects/679b7ccf3b0349b5afeb9bd4e3ac74ae => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:04.976005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:04.980479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:05.126226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:05.126907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.127164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.127466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] PATH_INFO: `/v3/projects/9f306c6079f54b1bb4b2c1837237619a` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.134162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f306c6079f54b1bb4b2c1837237619a)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:05.138148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:05.245719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9d77e-aaae-49fa-94b1-eb64f501b284 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:05.267539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23971-13b1-4aa9-8d4a-393cc78dde20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:05.275747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23971-13b1-4aa9-8d4a-393cc78dde20 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.275747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23971-13b1-4aa9-8d4a-393cc78dde20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.275747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23971-13b1-4aa9-8d4a-393cc78dde20 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.275747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe23971-13b1-4aa9-8d4a-393cc78dde20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:05.301749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe23971-13b1-4aa9-8d4a-393cc78dde20 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:05.379834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f306c6079f54b1bb4b2c1837237619a', 'request_id': 'req-443737ed-6f30-4d15-9061-1645a816ad23'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:05.398894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f306c6079f54b1bb4b2c1837237619a', 'request_id': 'req-443737ed-6f30-4d15-9061-1645a816ad23'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:05.469236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 877/1753] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:04 2022] POST /identity/v3/users => generated 294 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:05.470649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6a1db-b62a-4f5a-86a1-1d1e3d76c784 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.471247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6a1db-b62a-4f5a-86a1-1d1e3d76c784 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.474300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6a1db-b62a-4f5a-86a1-1d1e3d76c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.489925 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f306c6079f54b1bb4b2c1837237619a', 'request_id': 'req-443737ed-6f30-4d15-9061-1645a816ad23'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:05.508970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] The token cache is being invalidate because project 9f306c6079f54b1bb4b2c1837237619a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:05.509459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:05.511790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-443737ed-6f30-4d15-9061-1645a816ad23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:05.515720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 877/1754] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:04 2022] DELETE /identity/v3/projects/9f306c6079f54b1bb4b2c1837237619a => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:05.528235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf440-e84d-4e9f-9104-9d12ce8e0313 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.530539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf440-e84d-4e9f-9104-9d12ce8e0313 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.530826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cf440-e84d-4e9f-9104-9d12ce8e0313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.537448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-66b6a1db-b62a-4f5a-86a1-1d1e3d76c784 None None] MFA Rules not processed for user `de6bb3407c624210912f6e283a9e617b`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:05.540708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-66b6a1db-b62a-4f5a-86a1-1d1e3d76c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:05.592462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-225cf440-e84d-4e9f-9104-9d12ce8e0313 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:05.594442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-225cf440-e84d-4e9f-9104-9d12ce8e0313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:05.664954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 878/1755] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:05.666269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e9e7b-cf12-4c42-a159-33147bd65645 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.666509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e9e7b-cf12-4c42-a159-33147bd65645 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.666784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e9e7b-cf12-4c42-a159-33147bd65645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.750399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 878/1756] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:05.752502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf440-e84d-4e9f-9104-9d12ce8e0313 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:05.758926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-225cf440-e84d-4e9f-9104-9d12ce8e0313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:05.771386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-0c8e9e7b-cf12-4c42-a159-33147bd65645 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:05.772586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0c8e9e7b-cf12-4c42-a159-33147bd65645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:05.785319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cf440-e84d-4e9f-9104-9d12ce8e0313 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:05.794217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad1ba9-63d3-4e0f-9e81-16a0ffa58d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:05.794846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad1ba9-63d3-4e0f-9e81-16a0ffa58d41 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.795121 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad1ba9-63d3-4e0f-9e81-16a0ffa58d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.795417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad1ba9-63d3-4e0f-9e81-16a0ffa58d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.796060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad1ba9-63d3-4e0f-9e81-16a0ffa58d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:05.797638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad1ba9-63d3-4e0f-9e81-16a0ffa58d41 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:05.823677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 879/1757] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:05.826553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9b6cb-1a31-4750-b5bd-5dda9c318c53 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.826918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9b6cb-1a31-4750-b5bd-5dda9c318c53 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.827268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9b6cb-1a31-4750-b5bd-5dda9c318c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.864012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-cbb9b6cb-1a31-4750-b5bd-5dda9c318c53 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:05.865981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cbb9b6cb-1a31-4750-b5bd-5dda9c318c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:05.891480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 879/1758] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:05.892690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e9e7b-cf12-4c42-a159-33147bd65645 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:05.894192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0c8e9e7b-cf12-4c42-a159-33147bd65645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:05.900655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 880/1759] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:05.904062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98625e-affb-4a00-a24d-51cbddbcf012 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.904355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98625e-affb-4a00-a24d-51cbddbcf012 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.904631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98625e-affb-4a00-a24d-51cbddbcf012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.923797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e9e7b-cf12-4c42-a159-33147bd65645 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:05.929346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170b8e7-cb1d-4ab2-bcde-1ab11e96eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:05.930259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170b8e7-cb1d-4ab2-bcde-1ab11e96eb87 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.931423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170b8e7-cb1d-4ab2-bcde-1ab11e96eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.931704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170b8e7-cb1d-4ab2-bcde-1ab11e96eb87 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.932358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170b8e7-cb1d-4ab2-bcde-1ab11e96eb87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:05.934594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170b8e7-cb1d-4ab2-bcde-1ab11e96eb87 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:05.947522 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ef98625e-affb-4a00-a24d-51cbddbcf012 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:05.949381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ef98625e-affb-4a00-a24d-51cbddbcf012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:05.964159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 881/1760] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:05.964159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98625e-affb-4a00-a24d-51cbddbcf012 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:05.976755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98625e-affb-4a00-a24d-51cbddbcf012 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:05.982419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eecc1-3539-4e4e-89d7-45b369e53b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:05.982986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eecc1-3539-4e4e-89d7-45b369e53b33 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:05.983390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eecc1-3539-4e4e-89d7-45b369e53b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:05.983730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eecc1-3539-4e4e-89d7-45b369e53b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:05.984493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eecc1-3539-4e4e-89d7-45b369e53b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:05.986533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eecc1-3539-4e4e-89d7-45b369e53b33 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:06.001790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 882/1761] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:06.001790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4408dd-eb34-44cb-867f-b8a0d6626dec None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.001790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4408dd-eb34-44cb-867f-b8a0d6626dec None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.001790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4408dd-eb34-44cb-867f-b8a0d6626dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.041920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-5a4408dd-eb34-44cb-867f-b8a0d6626dec None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:06.043325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5a4408dd-eb34-44cb-867f-b8a0d6626dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:06.057091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 883/1762] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:06.059528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4408dd-eb34-44cb-867f-b8a0d6626dec None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:06.073190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4408dd-eb34-44cb-867f-b8a0d6626dec None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:06.079552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 880/1763] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:05 2022] POST /identity/v3/projects => generated 403 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:06.079883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a740808-f75e-45c7-8ec3-b743ace3ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:06.080571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a740808-f75e-45c7-8ec3-b743ace3ee8b admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.080927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a740808-f75e-45c7-8ec3-b743ace3ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.081341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a740808-f75e-45c7-8ec3-b743ace3ee8b admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.081686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170b8e7-cb1d-4ab2-bcde-1ab11e96eb87 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:06.082353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a740808-f75e-45c7-8ec3-b743ace3ee8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:06.082734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a740808-f75e-45c7-8ec3-b743ace3ee8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:06.084486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a740808-f75e-45c7-8ec3-b743ace3ee8b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:06.102841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 884/1764] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:06.103648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a740808-f75e-45c7-8ec3-b743ace3ee8b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:06.120088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a740808-f75e-45c7-8ec3-b743ace3ee8b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:06.204809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076452cf-bf82-48e5-adfa-b90b891a1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:06.205417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076452cf-bf82-48e5-adfa-b90b891a1e27 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.206066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076452cf-bf82-48e5-adfa-b90b891a1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.206608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076452cf-bf82-48e5-adfa-b90b891a1e27 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.207273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076452cf-bf82-48e5-adfa-b90b891a1e27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:06.207601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076452cf-bf82-48e5-adfa-b90b891a1e27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:06.208639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170b8e7-cb1d-4ab2-bcde-1ab11e96eb87 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:06.209195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076452cf-bf82-48e5-adfa-b90b891a1e27 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:06.216972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369491ca-9005-423f-bf9d-cabc6eef962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:06.218665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369491ca-9005-423f-bf9d-cabc6eef962b admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.219044 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369491ca-9005-423f-bf9d-cabc6eef962b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.219426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369491ca-9005-423f-bf9d-cabc6eef962b admin admin] PATH_INFO: `/v3/projects/04f91f2a64b343fba591d78e28f2ae8a/users/550142a4fe28429bbb85d9497b48dfc7/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.243488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369491ca-9005-423f-bf9d-cabc6eef962b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f91f2a64b343fba591d78e28f2ae8a, user_id=550142a4fe28429bbb85d9497b48dfc7, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:06.247055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369491ca-9005-423f-bf9d-cabc6eef962b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:06.248308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 885/1765] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:06.251821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076452cf-bf82-48e5-adfa-b90b891a1e27 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:06.269417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076452cf-bf82-48e5-adfa-b90b891a1e27 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:06.277880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727a9b-32b8-4dc9-be5e-a34b9fc7fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:06.278782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727a9b-32b8-4dc9-be5e-a34b9fc7fc12 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.279163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727a9b-32b8-4dc9-be5e-a34b9fc7fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.279674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68727a9b-32b8-4dc9-be5e-a34b9fc7fc12 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.280412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68727a9b-32b8-4dc9-be5e-a34b9fc7fc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:06.282655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68727a9b-32b8-4dc9-be5e-a34b9fc7fc12 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:06.384058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 881/1766] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:06 2022] PUT /identity/v3/projects/04f91f2a64b343fba591d78e28f2ae8a/users/550142a4fe28429bbb85d9497b48dfc7/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:06.385181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369491ca-9005-423f-bf9d-cabc6eef962b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:06.401685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 886/1767] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:06 2022] POST /identity/v3/users => generated 308 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:06.402564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727a9b-32b8-4dc9-be5e-a34b9fc7fc12 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:06.452592 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:06.454478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68727a9b-32b8-4dc9-be5e-a34b9fc7fc12 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:06.496536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369491ca-9005-423f-bf9d-cabc6eef962b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:06.502943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991dd2-6afc-4c70-b33a-019e3602c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:06.508031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991dd2-6afc-4c70-b33a-019e3602c137 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.508411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991dd2-6afc-4c70-b33a-019e3602c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.508772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a991dd2-6afc-4c70-b33a-019e3602c137 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.510111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991dd2-6afc-4c70-b33a-019e3602c137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:06.513324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a991dd2-6afc-4c70-b33a-019e3602c137 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:06.596132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19163d07-3651-481a-8186-14f4ec1aa1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:06.596769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163d07-3651-481a-8186-14f4ec1aa1bd admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.597070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163d07-3651-481a-8186-14f4ec1aa1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.598840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163d07-3651-481a-8186-14f4ec1aa1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.599523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19163d07-3651-481a-8186-14f4ec1aa1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:06.601728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19163d07-3651-481a-8186-14f4ec1aa1bd admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:06.656717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 882/1768] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:06 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:06.657734 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991dd2-6afc-4c70-b33a-019e3602c137 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:06.659700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8a991dd2-6afc-4c70-b33a-019e3602c137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:06.702927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 887/1769] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:06 2022] POST /identity/v3/projects => generated 371 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:06.706195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b29e0b-ebc7-4a81-be05-2afe7d87b4d0 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.707502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b29e0b-ebc7-4a81-be05-2afe7d87b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.708300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b29e0b-ebc7-4a81-be05-2afe7d87b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.782699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-36b29e0b-ebc7-4a81-be05-2afe7d87b4d0 None None] MFA Rules not processed for user `550142a4fe28429bbb85d9497b48dfc7`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:06.786263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-36b29e0b-ebc7-4a81-be05-2afe7d87b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:06.887053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a991dd2-6afc-4c70-b33a-019e3602c137 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:06.966820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 888/1770] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:06.969050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b29e0b-ebc7-4a81-be05-2afe7d87b4d0 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:06.974586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:06.988217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7003cd1-eb90-41b4-94fb-f0c4c554d4b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:06.989454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7003cd1-eb90-41b4-94fb-f0c4c554d4b6 service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.989625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7003cd1-eb90-41b4-94fb-f0c4c554d4b6 service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.990183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7003cd1-eb90-41b4-94fb-f0c4c554d4b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.129901 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b29e0b-ebc7-4a81-be05-2afe7d87b4d0 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:07.143443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62043831-f376-4e33-b991-370450771e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:07.156520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62043831-f376-4e33-b991-370450771e40 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:07.157384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62043831-f376-4e33-b991-370450771e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:07.158418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62043831-f376-4e33-b991-370450771e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.159559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62043831-f376-4e33-b991-370450771e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:07.161731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62043831-f376-4e33-b991-370450771e40 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:07.179541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 889/1771] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:07.181649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62043831-f376-4e33-b991-370450771e40 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:07.188770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7003cd1-eb90-41b4-94fb-f0c4c554d4b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:07.191134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7003cd1-eb90-41b4-94fb-f0c4c554d4b6 service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:07.205247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 883/1772] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 07:55:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:55:07.206193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7003cd1-eb90-41b4-94fb-f0c4c554d4b6 service swift] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:07.218711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62043831-f376-4e33-b991-370450771e40 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:07.219436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7003cd1-eb90-41b4-94fb-f0c4c554d4b6 service swift] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:07.225997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9aedbf-8afb-4891-b01a-4f0dc92b4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:07.227032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aedbf-8afb-4891-b01a-4f0dc92b4978 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:07.227548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aedbf-8afb-4891-b01a-4f0dc92b4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:07.228086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aedbf-8afb-4891-b01a-4f0dc92b4978 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.232156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9aedbf-8afb-4891-b01a-4f0dc92b4978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:07.232156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9aedbf-8afb-4891-b01a-4f0dc92b4978 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:07.243696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0b8f4-534a-4eda-8c87-61eace8abf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:07.245375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0b8f4-534a-4eda-8c87-61eace8abf3b admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:07.251748 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0b8f4-534a-4eda-8c87-61eace8abf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:07.252209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0b8f4-534a-4eda-8c87-61eace8abf3b admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.255109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0b8f4-534a-4eda-8c87-61eace8abf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:07.255109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0b8f4-534a-4eda-8c87-61eace8abf3b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:07.376944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 884/1773] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:07 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:07.378025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9aedbf-8afb-4891-b01a-4f0dc92b4978 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:07.389096 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 890/1774] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:07 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:07.391229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0b8f4-534a-4eda-8c87-61eace8abf3b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:07.425168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9aedbf-8afb-4891-b01a-4f0dc92b4978 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:07.452629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2986-0c7c-44ea-81fa-ad2771d730ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:07.452629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2986-0c7c-44ea-81fa-ad2771d730ab admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:07.452629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2986-0c7c-44ea-81fa-ad2771d730ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:07.452629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2986-0c7c-44ea-81fa-ad2771d730ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.453333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c2986-0c7c-44ea-81fa-ad2771d730ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:07.456380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0b8f4-534a-4eda-8c87-61eace8abf3b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:07.461530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c2986-0c7c-44ea-81fa-ad2771d730ab admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:07.472167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06405ed4-53c3-4412-8e52-db73aecf1872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:07.472863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06405ed4-53c3-4412-8e52-db73aecf1872 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:07.477113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06405ed4-53c3-4412-8e52-db73aecf1872 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:07.477113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06405ed4-53c3-4412-8e52-db73aecf1872 admin admin] PATH_INFO: `/v3/projects/f53baa382eb3494d8281c10264030a35/users/af2f801fcb1444b299cf0fec0ce5e4d4/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.552595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06405ed4-53c3-4412-8e52-db73aecf1872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53baa382eb3494d8281c10264030a35, user_id=af2f801fcb1444b299cf0fec0ce5e4d4, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:07.569366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06405ed4-53c3-4412-8e52-db73aecf1872 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:07.639895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 885/1775] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:07 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:07.639895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2986-0c7c-44ea-81fa-ad2771d730ab admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:07.671640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 891/1776] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:07 2022] PUT /identity/v3/projects/f53baa382eb3494d8281c10264030a35/users/af2f801fcb1444b299cf0fec0ce5e4d4/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:07.672786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06405ed4-53c3-4412-8e52-db73aecf1872 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:07.761062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:07.930269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c2986-0c7c-44ea-81fa-ad2771d730ab admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:07.932808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06405ed4-53c3-4412-8e52-db73aecf1872 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:07.932808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd4570-850b-421a-9a73-d78a98a456aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:07.932808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd4570-850b-421a-9a73-d78a98a456aa admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:07.932808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd4570-850b-421a-9a73-d78a98a456aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:07.933530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd4570-850b-421a-9a73-d78a98a456aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.933530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd4570-850b-421a-9a73-d78a98a456aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:07.933530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd4570-850b-421a-9a73-d78a98a456aa admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:07.933530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 892/1777] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:07.933530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c983e-8c76-481b-a92e-5a94ea74b3b8 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:07.933530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c983e-8c76-481b-a92e-5a94ea74b3b8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:07.933903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c983e-8c76-481b-a92e-5a94ea74b3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.956397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7e4c983e-8c76-481b-a92e-5a94ea74b3b8 None None] MFA Rules not processed for user `a4403ef0835a4d658f8eb50fac0780eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:07.957287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7e4c983e-8c76-481b-a92e-5a94ea74b3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:07.989966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14455b6c-c8cb-4280-bf96-728fcf6e96dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:07.990878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455b6c-c8cb-4280-bf96-728fcf6e96dd admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:07.991229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455b6c-c8cb-4280-bf96-728fcf6e96dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:07.991624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455b6c-c8cb-4280-bf96-728fcf6e96dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.992358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14455b6c-c8cb-4280-bf96-728fcf6e96dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:07.994267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14455b6c-c8cb-4280-bf96-728fcf6e96dd admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.021242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 886/1778] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:08.024433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14455b6c-c8cb-4280-bf96-728fcf6e96dd admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.053974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14455b6c-c8cb-4280-bf96-728fcf6e96dd admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.115771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 893/1779] 10.222.0.61 () {58 vars in 1015 bytes} [Wed Aug 24 07:55:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:08.115771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c983e-8c76-481b-a92e-5a94ea74b3b8 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.116960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127092c8-a085-4df7-8b7b-57af427ce86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.116960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127092c8-a085-4df7-8b7b-57af427ce86c admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.116960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127092c8-a085-4df7-8b7b-57af427ce86c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.116960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127092c8-a085-4df7-8b7b-57af427ce86c admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.117237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127092c8-a085-4df7-8b7b-57af427ce86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.117310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c983e-8c76-481b-a92e-5a94ea74b3b8 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.117382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127092c8-a085-4df7-8b7b-57af427ce86c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.117453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2ee9-0c55-4135-b368-98139a4b2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.117453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2ee9-0c55-4135-b368-98139a4b2efd admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.117453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2ee9-0c55-4135-b368-98139a4b2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.117453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2ee9-0c55-4135-b368-98139a4b2efd admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.117713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e2ee9-0c55-4135-b368-98139a4b2efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.117713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e2ee9-0c55-4135-b368-98139a4b2efd admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.117713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 894/1780] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:08.117713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2ee9-0c55-4135-b368-98139a4b2efd admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.117713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2ee9-0c55-4135-b368-98139a4b2efd admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.123647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc61636-0f75-488c-a5a9-5acebd792628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.124586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61636-0f75-488c-a5a9-5acebd792628 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.125031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61636-0f75-488c-a5a9-5acebd792628 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.125510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61636-0f75-488c-a5a9-5acebd792628 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.126514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc61636-0f75-488c-a5a9-5acebd792628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.134643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc61636-0f75-488c-a5a9-5acebd792628 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.181798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 895/1781] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:08.182859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc61636-0f75-488c-a5a9-5acebd792628 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.218159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc61636-0f75-488c-a5a9-5acebd792628 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.232216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864e00d-8ce8-4468-90d2-37ab141e1a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.232909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864e00d-8ce8-4468-90d2-37ab141e1a60 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.233118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864e00d-8ce8-4468-90d2-37ab141e1a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.234254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864e00d-8ce8-4468-90d2-37ab141e1a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.234918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864e00d-8ce8-4468-90d2-37ab141e1a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.239929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864e00d-8ce8-4468-90d2-37ab141e1a60 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.273179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 896/1782] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:08.273831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864e00d-8ce8-4468-90d2-37ab141e1a60 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.284067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8864e00d-8ce8-4468-90d2-37ab141e1a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:08.347162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864e00d-8ce8-4468-90d2-37ab141e1a60 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.372187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946198-297f-4536-80c9-c2a17c4171ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.373245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946198-297f-4536-80c9-c2a17c4171ff service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.373541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946198-297f-4536-80c9-c2a17c4171ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.373867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946198-297f-4536-80c9-c2a17c4171ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.377004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 887/1783] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:08 2022] POST /identity/v3/users => generated 300 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:08.378179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127092c8-a085-4df7-8b7b-57af427ce86c admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.403667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127092c8-a085-4df7-8b7b-57af427ce86c admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.409826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60946198-297f-4536-80c9-c2a17c4171ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.413741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a403-e2be-4f18-90bc-81ff0dd8aa99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.414251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a403-e2be-4f18-90bc-81ff0dd8aa99 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.414615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a403-e2be-4f18-90bc-81ff0dd8aa99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.414959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982a403-e2be-4f18-90bc-81ff0dd8aa99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.417391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60946198-297f-4536-80c9-c2a17c4171ff service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.433771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982a403-e2be-4f18-90bc-81ff0dd8aa99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.437224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982a403-e2be-4f18-90bc-81ff0dd8aa99 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.465811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 888/1784] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:08.466847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a403-e2be-4f18-90bc-81ff0dd8aa99 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.486526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 897/1785] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:08.487610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946198-297f-4536-80c9-c2a17c4171ff service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.491793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982a403-e2be-4f18-90bc-81ff0dd8aa99 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.505322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9504e5-71a1-423d-b8b6-23bcb49f52fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.506197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9504e5-71a1-423d-b8b6-23bcb49f52fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.506603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9504e5-71a1-423d-b8b6-23bcb49f52fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.507052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9504e5-71a1-423d-b8b6-23bcb49f52fa admin admin] PATH_INFO: `/v3/projects/f53baa382eb3494d8281c10264030a35/users/af2f801fcb1444b299cf0fec0ce5e4d4/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.515427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9504e5-71a1-423d-b8b6-23bcb49f52fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53baa382eb3494d8281c10264030a35, user_id=af2f801fcb1444b299cf0fec0ce5e4d4, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.518378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9504e5-71a1-423d-b8b6-23bcb49f52fa admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.527197 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946198-297f-4536-80c9-c2a17c4171ff service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.543751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 889/1786] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:08 2022] PUT /identity/v3/projects/f53baa382eb3494d8281c10264030a35/users/af2f801fcb1444b299cf0fec0ce5e4d4/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:08.545525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9504e5-71a1-423d-b8b6-23bcb49f52fa admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.554427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aeacd-ded0-4a08-95f3-97eec15f45b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.554552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4d9504e5-71a1-423d-b8b6-23bcb49f52fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:08.557323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:08.558866 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aeacd-ded0-4a08-95f3-97eec15f45b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.559168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aeacd-ded0-4a08-95f3-97eec15f45b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.559483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aeacd-ded0-4a08-95f3-97eec15f45b6 admin admin] PATH_INFO: `/v3/projects/9ea2339352f54496bd4283d5a06e1250/users/40873f94ee43488fa08deffde98057a0/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.615909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33aeacd-ded0-4a08-95f3-97eec15f45b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea2339352f54496bd4283d5a06e1250, user_id=40873f94ee43488fa08deffde98057a0, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.624686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33aeacd-ded0-4a08-95f3-97eec15f45b6 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.706441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 898/1787] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:08 2022] PUT /identity/v3/projects/9ea2339352f54496bd4283d5a06e1250/users/40873f94ee43488fa08deffde98057a0/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:08.707384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aeacd-ded0-4a08-95f3-97eec15f45b6 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.718417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9504e5-71a1-423d-b8b6-23bcb49f52fa admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.856316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd534f63-1ac3-4ff0-a110-a2024d46d161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.857013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd534f63-1ac3-4ff0-a110-a2024d46d161 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.857250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd534f63-1ac3-4ff0-a110-a2024d46d161 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.857532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd534f63-1ac3-4ff0-a110-a2024d46d161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.879347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd534f63-1ac3-4ff0-a110-a2024d46d161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.882266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd534f63-1ac3-4ff0-a110-a2024d46d161 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.896043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aeacd-ded0-4a08-95f3-97eec15f45b6 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.904480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 890/1788] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:08.909159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd534f63-1ac3-4ff0-a110-a2024d46d161 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:08.909281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aa795-b43d-4b56-bca5-b8bce2a874ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.909281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa795-b43d-4b56-bca5-b8bce2a874ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.909281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa795-b43d-4b56-bca5-b8bce2a874ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.909281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa795-b43d-4b56-bca5-b8bce2a874ae admin admin] PATH_INFO: `/v3/projects/b78e7675e9ca4a089f1de4534f12eda0/users/e2c6f9118f2040109c7a58186d0b9a49/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.949778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd534f63-1ac3-4ff0-a110-a2024d46d161 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:08.955481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:08.964979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a94d7-e5ea-4991-b232-fef68e358bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:08.965614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a94d7-e5ea-4991-b232-fef68e358bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:08.965920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a94d7-e5ea-4991-b232-fef68e358bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:08.976296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a94d7-e5ea-4991-b232-fef68e358bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:08.978890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a94d7-e5ea-4991-b232-fef68e358bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.982875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a94d7-e5ea-4991-b232-fef68e358bf6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:08.988820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92aa795-b43d-4b56-bca5-b8bce2a874ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78e7675e9ca4a089f1de4534f12eda0, user_id=e2c6f9118f2040109c7a58186d0b9a49, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:08.993455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92aa795-b43d-4b56-bca5-b8bce2a874ae admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:09.011010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 891/1789] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:09.012401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a94d7-e5ea-4991-b232-fef68e358bf6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:09.050486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a94d7-e5ea-4991-b232-fef68e358bf6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:09.070461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15936b-3773-4bf9-b603-35161a92798a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:09.073396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15936b-3773-4bf9-b603-35161a92798a service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:09.073915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15936b-3773-4bf9-b603-35161a92798a service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:09.074256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15936b-3773-4bf9-b603-35161a92798a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:09.102566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15936b-3773-4bf9-b603-35161a92798a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:09.108805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15936b-3773-4bf9-b603-35161a92798a service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:09.127181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 899/1790] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:08 2022] PUT /identity/v3/projects/b78e7675e9ca4a089f1de4534f12eda0/users/e2c6f9118f2040109c7a58186d0b9a49/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:09.127181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83852859-7d10-461f-a48f-a2c0baf0f853 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:09.127181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83852859-7d10-461f-a48f-a2c0baf0f853 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:09.127181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83852859-7d10-461f-a48f-a2c0baf0f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:09.173788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 892/1791] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:09.177697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15936b-3773-4bf9-b603-35161a92798a service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:09.226227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15936b-3773-4bf9-b603-35161a92798a service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:09.264740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-83852859-7d10-461f-a48f-a2c0baf0f853 None None] MFA Rules not processed for user `40873f94ee43488fa08deffde98057a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:09.269345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-83852859-7d10-461f-a48f-a2c0baf0f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:09.431884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c485-2439-4bcd-b5a6-ee47b95540c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:09.432932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c485-2439-4bcd-b5a6-ee47b95540c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:09.433434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c485-2439-4bcd-b5a6-ee47b95540c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:09.434170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5c485-2439-4bcd-b5a6-ee47b95540c3 admin admin] PATH_INFO: `/v3/projects/451fbee466dc4d099158086618c1b8a4/users/3ec20ee12fc3407e8727ca9e28b6e08e/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:09.469559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5c485-2439-4bcd-b5a6-ee47b95540c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451fbee466dc4d099158086618c1b8a4, user_id=3ec20ee12fc3407e8727ca9e28b6e08e, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:09.471722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5c485-2439-4bcd-b5a6-ee47b95540c3 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:09.481695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 900/1792] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:09.483333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e36b26-79e2-4a10-809e-69aee82f4392 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:09.483859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e36b26-79e2-4a10-809e-69aee82f4392 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:09.484308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e36b26-79e2-4a10-809e-69aee82f4392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:09.530010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b3e36b26-79e2-4a10-809e-69aee82f4392 None None] MFA Rules not processed for user `e2c6f9118f2040109c7a58186d0b9a49`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:09.534591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:09.536725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b3e36b26-79e2-4a10-809e-69aee82f4392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:09.600588 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 893/1793] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:09 2022] PUT /identity/v3/projects/451fbee466dc4d099158086618c1b8a4/users/3ec20ee12fc3407e8727ca9e28b6e08e/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:09.604646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c485-2439-4bcd-b5a6-ee47b95540c3 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:09.671536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 901/1794] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:09.672599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e36b26-79e2-4a10-809e-69aee82f4392 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:09.710027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e36b26-79e2-4a10-809e-69aee82f4392 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:09.748983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5c485-2439-4bcd-b5a6-ee47b95540c3 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:09.760383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60b105-2906-4686-b2a2-ff657767803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:09.763527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60b105-2906-4686-b2a2-ff657767803f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:09.763527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60b105-2906-4686-b2a2-ff657767803f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:09.763527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60b105-2906-4686-b2a2-ff657767803f admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:09.763527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60b105-2906-4686-b2a2-ff657767803f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:09.765225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60b105-2906-4686-b2a2-ff657767803f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:09.875762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 894/1795] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:09 2022] POST /identity/v3/projects => generated 387 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:09.878267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60b105-2906-4686-b2a2-ff657767803f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:09.884342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5c60b105-2906-4686-b2a2-ff657767803f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:09.888633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260d612-48f4-4e27-8982-3dcc89cec66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:09.890966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260d612-48f4-4e27-8982-3dcc89cec66c admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:09.891341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260d612-48f4-4e27-8982-3dcc89cec66c admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:09.892563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260d612-48f4-4e27-8982-3dcc89cec66c admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:09.893678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260d612-48f4-4e27-8982-3dcc89cec66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:09.897841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260d612-48f4-4e27-8982-3dcc89cec66c admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:09.940922 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 902/1796] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:09.961084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260d612-48f4-4e27-8982-3dcc89cec66c admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:10.002922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:10.006934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260d612-48f4-4e27-8982-3dcc89cec66c admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:10.066389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60b105-2906-4686-b2a2-ff657767803f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:10.076817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b59d-82fb-4bab-8ba7-797d3774a5b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:10.088402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b59d-82fb-4bab-8ba7-797d3774a5b9 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.088402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b59d-82fb-4bab-8ba7-797d3774a5b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.088402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b59d-82fb-4bab-8ba7-797d3774a5b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.179417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6f2b-7391-4860-8571-56182f995abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:10.180098 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6f2b-7391-4860-8571-56182f995abf admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.185816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6f2b-7391-4860-8571-56182f995abf admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.185816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6f2b-7391-4860-8571-56182f995abf admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.185816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc6f2b-7391-4860-8571-56182f995abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:10.185816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc6f2b-7391-4860-8571-56182f995abf admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:10.216639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195b59d-82fb-4bab-8ba7-797d3774a5b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:10.218114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195b59d-82fb-4bab-8ba7-797d3774a5b9 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:10.229168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 895/1797] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:10.230018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b59d-82fb-4bab-8ba7-797d3774a5b9 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:10.245777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b59d-82fb-4bab-8ba7-797d3774a5b9 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:10.250115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403e43-25e2-4114-a818-05acba26f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:10.251117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403e43-25e2-4114-a818-05acba26f158 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.251617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403e43-25e2-4114-a818-05acba26f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.252134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403e43-25e2-4114-a818-05acba26f158 admin admin] PATH_INFO: `/v3/projects/451fbee466dc4d099158086618c1b8a4/users/3ec20ee12fc3407e8727ca9e28b6e08e/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.257235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403e43-25e2-4114-a818-05acba26f158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451fbee466dc4d099158086618c1b8a4, user_id=3ec20ee12fc3407e8727ca9e28b6e08e, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:10.260315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403e43-25e2-4114-a818-05acba26f158 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:10.273947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 903/1798] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:09 2022] POST /identity/v3/users => generated 300 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:10.275724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6f2b-7391-4860-8571-56182f995abf admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:10.293692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6f2b-7391-4860-8571-56182f995abf admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:10.302681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 896/1799] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:10 2022] PUT /identity/v3/projects/451fbee466dc4d099158086618c1b8a4/users/3ec20ee12fc3407e8727ca9e28b6e08e/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:10.305023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403e43-25e2-4114-a818-05acba26f158 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:10.495319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403e43-25e2-4114-a818-05acba26f158 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:10.523395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437235d-5f84-4e63-afdc-11fe9c0e8885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:10.524440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437235d-5f84-4e63-afdc-11fe9c0e8885 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.524923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437235d-5f84-4e63-afdc-11fe9c0e8885 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.525922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437235d-5f84-4e63-afdc-11fe9c0e8885 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.526795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437235d-5f84-4e63-afdc-11fe9c0e8885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:10.541736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437235d-5f84-4e63-afdc-11fe9c0e8885 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:10.543036 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:10.543745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.544004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.544281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] PATH_INFO: `/v3/users/e2c6f9118f2040109c7a58186d0b9a49` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.549016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c6f9118f2040109c7a58186d0b9a49)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:10.555890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:10.591565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 897/1800] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:10.608772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf8fbc-285a-4c7c-9404-5dfc7e990018 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.609152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf8fbc-285a-4c7c-9404-5dfc7e990018 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.609617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf8fbc-285a-4c7c-9404-5dfc7e990018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.658471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-84bf8fbc-285a-4c7c-9404-5dfc7e990018 None None] MFA Rules not processed for user `3ec20ee12fc3407e8727ca9e28b6e08e`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:10.660144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-84bf8fbc-285a-4c7c-9404-5dfc7e990018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:10.765766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:10.775878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 898/1801] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:10.775878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf8fbc-285a-4c7c-9404-5dfc7e990018 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:10.803592 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf8fbc-285a-4c7c-9404-5dfc7e990018 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:10.813960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434943fe-84d0-4615-9e43-f06361d220c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:10.814582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434943fe-84d0-4615-9e43-f06361d220c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.814868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434943fe-84d0-4615-9e43-f06361d220c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.815143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434943fe-84d0-4615-9e43-f06361d220c9 admin admin] PATH_INFO: `/v3/projects/4636d1bc38e54283a5cd6e0500b53f18/users/2a574f9a01474f09bac228f95e3910d0/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.817178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c6f9118f2040109c7a58186d0b9a49'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:10.818166 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c6f9118f2040109c7a58186d0b9a49'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:10.820138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c6f9118f2040109c7a58186d0b9a49'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:10.846774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434943fe-84d0-4615-9e43-f06361d220c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4636d1bc38e54283a5cd6e0500b53f18, user_id=2a574f9a01474f09bac228f95e3910d0, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:10.850833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434943fe-84d0-4615-9e43-f06361d220c9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:10.901647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c6f9118f2040109c7a58186d0b9a49'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:10.924048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c6f9118f2040109c7a58186d0b9a49'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:10.956999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 904/1802] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:10 2022] DELETE /identity/v3/users/e2c6f9118f2040109c7a58186d0b9a49 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:10.961109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:10.972169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 899/1803] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:10 2022] PUT /identity/v3/projects/4636d1bc38e54283a5cd6e0500b53f18/users/2a574f9a01474f09bac228f95e3910d0/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:10.978104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a18308-1534-4027-aef2-0ed0b89d213f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.978392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a18308-1534-4027-aef2-0ed0b89d213f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.978768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a18308-1534-4027-aef2-0ed0b89d213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.983776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:11.039839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e6a18308-1534-4027-aef2-0ed0b89d213f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:11.041101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e6a18308-1534-4027-aef2-0ed0b89d213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:11.096035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb632f8b-6c54-4a8e-b82a-31c97dc43c4a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:11.214128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad514b-207c-4d22-8040-398ef1a7b4ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:11.215415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad514b-207c-4d22-8040-398ef1a7b4ab service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:11.216314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad514b-207c-4d22-8040-398ef1a7b4ab service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:11.227825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad514b-207c-4d22-8040-398ef1a7b4ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:11.232989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-baad514b-207c-4d22-8040-398ef1a7b4ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:11.249541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 900/1804] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:11.250657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a18308-1534-4027-aef2-0ed0b89d213f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:11.254584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e6a18308-1534-4027-aef2-0ed0b89d213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:11.292155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a18308-1534-4027-aef2-0ed0b89d213f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:11.302307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99268d-8c29-49ee-94b0-e0f4360beee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:11.302718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99268d-8c29-49ee-94b0-e0f4360beee3 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:11.303899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99268d-8c29-49ee-94b0-e0f4360beee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:11.305200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99268d-8c29-49ee-94b0-e0f4360beee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:11.309108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99268d-8c29-49ee-94b0-e0f4360beee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:11.315888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99268d-8c29-49ee-94b0-e0f4360beee3 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:11.333125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 901/1805] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:11.334843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99268d-8c29-49ee-94b0-e0f4360beee3 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:11.340320 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bd99268d-8c29-49ee-94b0-e0f4360beee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:11.420493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad514b-207c-4d22-8040-398ef1a7b4ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:11.420493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad514b-207c-4d22-8040-398ef1a7b4ab service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:11.444497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 905/1806] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:11.447204 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad514b-207c-4d22-8040-398ef1a7b4ab service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:11.466408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad514b-207c-4d22-8040-398ef1a7b4ab service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:11.476391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b3f58-529f-4878-8e83-4e08391551ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:11.480949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99268d-8c29-49ee-94b0-e0f4360beee3 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:11.481107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b3f58-529f-4878-8e83-4e08391551ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:11.481601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b3f58-529f-4878-8e83-4e08391551ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:11.485396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b3f58-529f-4878-8e83-4e08391551ed admin admin] PATH_INFO: `/v3/projects/4636d1bc38e54283a5cd6e0500b53f18/users/2a574f9a01474f09bac228f95e3910d0/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:11.487618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572187f-12a0-4d67-abcd-501ee74f3bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:11.488421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572187f-12a0-4d67-abcd-501ee74f3bcf service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:11.488683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572187f-12a0-4d67-abcd-501ee74f3bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:11.488962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572187f-12a0-4d67-abcd-501ee74f3bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:11.492304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b3f58-529f-4878-8e83-4e08391551ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4636d1bc38e54283a5cd6e0500b53f18, user_id=2a574f9a01474f09bac228f95e3910d0, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:11.496610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b3f58-529f-4878-8e83-4e08391551ed admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:11.515258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 906/1807] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:11 2022] PUT /identity/v3/projects/4636d1bc38e54283a5cd6e0500b53f18/users/2a574f9a01474f09bac228f95e3910d0/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:11.526323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af939b-7ea4-4f0a-88db-f6929c6921cd None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:11.528357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af939b-7ea4-4f0a-88db-f6929c6921cd None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:11.528357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af939b-7ea4-4f0a-88db-f6929c6921cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:11.539110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572187f-12a0-4d67-abcd-501ee74f3bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:11.542586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572187f-12a0-4d67-abcd-501ee74f3bcf service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:11.559705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:11.588991 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 902/1808] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:11.639463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-66af939b-7ea4-4f0a-88db-f6929c6921cd None None] MFA Rules not processed for user `2a574f9a01474f09bac228f95e3910d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:11.643346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-66af939b-7ea4-4f0a-88db-f6929c6921cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:11.653080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572187f-12a0-4d67-abcd-501ee74f3bcf service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:11.654843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8572187f-12a0-4d67-abcd-501ee74f3bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:11.689864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572187f-12a0-4d67-abcd-501ee74f3bcf service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:11.855679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:11.855784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:11.855784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:11.856110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:11.857720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] PATH_INFO: `/v3/users/550142a4fe28429bbb85d9497b48dfc7` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:11.860489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=550142a4fe28429bbb85d9497b48dfc7)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:11.864663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:11.879901 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 907/1809] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:11.882659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690080f1-408b-463e-9299-0ce8309734ee None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:11.884212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690080f1-408b-463e-9299-0ce8309734ee None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:11.884212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690080f1-408b-463e-9299-0ce8309734ee None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:11.884572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 908/1810] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:11.898052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690080f1-408b-463e-9299-0ce8309734ee None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:12.012187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690080f1-408b-463e-9299-0ce8309734ee None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:12.037206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e563b-b67e-44e5-bdd5-c84f8c7b5366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:12.038321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e563b-b67e-44e5-bdd5-c84f8c7b5366 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:12.039015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e563b-b67e-44e5-bdd5-c84f8c7b5366 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:12.039624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e563b-b67e-44e5-bdd5-c84f8c7b5366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:12.063092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e563b-b67e-44e5-bdd5-c84f8c7b5366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:12.064844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e563b-b67e-44e5-bdd5-c84f8c7b5366 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:12.110638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 909/1811] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:12.114960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ec76-2efc-4591-b77b-e78fcc73b72e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:12.115648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ec76-2efc-4591-b77b-e78fcc73b72e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:12.132939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ec76-2efc-4591-b77b-e78fcc73b72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:12.187375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550142a4fe28429bbb85d9497b48dfc7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:12.196583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550142a4fe28429bbb85d9497b48dfc7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:12.208730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-06f0ec76-2efc-4591-b77b-e78fcc73b72e None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:12.209938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550142a4fe28429bbb85d9497b48dfc7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:12.213838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-06f0ec76-2efc-4591-b77b-e78fcc73b72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:12.310595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550142a4fe28429bbb85d9497b48dfc7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:12.379573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-4216e73d-11d7-4e07-ba61-b4e7138f31dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550142a4fe28429bbb85d9497b48dfc7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:12.415946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 903/1812] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:11 2022] DELETE /identity/v3/users/550142a4fe28429bbb85d9497b48dfc7 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:12.431154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb0dbd-817d-4c44-a1ab-be475b303985 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:12.432030 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb0dbd-817d-4c44-a1ab-be475b303985 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:12.433171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb0dbd-817d-4c44-a1ab-be475b303985 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:12.438812 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 904/1813] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:55:12 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:12.439955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb0dbd-817d-4c44-a1ab-be475b303985 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:12.442476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-05eb0dbd-817d-4c44-a1ab-be475b303985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:12.443838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 910/1814] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:55:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:12.445464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55544390-f646-4c19-b8cb-977d77c34a75 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:12.445655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55544390-f646-4c19-b8cb-977d77c34a75 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:12.448663 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55544390-f646-4c19-b8cb-977d77c34a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:12.505934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-55544390-f646-4c19-b8cb-977d77c34a75 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:12.509411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-55544390-f646-4c19-b8cb-977d77c34a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:12.680291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb0dbd-817d-4c44-a1ab-be475b303985 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:12.683638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 911/1815] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:12.688415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28360a9b-c4a5-4dc9-a7dc-14cf2e56350e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:12.689023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28360a9b-c4a5-4dc9-a7dc-14cf2e56350e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:12.690664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28360a9b-c4a5-4dc9-a7dc-14cf2e56350e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:12.708233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:12.708945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:12.715281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:12.715418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:12.715511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] PATH_INFO: `/v3/users/40873f94ee43488fa08deffde98057a0` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:12.715511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40873f94ee43488fa08deffde98057a0)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:12.733623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:12.756592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-28360a9b-c4a5-4dc9-a7dc-14cf2e56350e None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:12.759126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-28360a9b-c4a5-4dc9-a7dc-14cf2e56350e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:12.910001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 912/1816] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:55:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:12.911565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c9f63-17ed-4188-9902-fffbe0152e78 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:12.911990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c9f63-17ed-4188-9902-fffbe0152e78 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:12.912350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c9f63-17ed-4188-9902-fffbe0152e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:12.954737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-240c9f63-17ed-4188-9902-fffbe0152e78 None None] MFA Rules not processed for user `af2f801fcb1444b299cf0fec0ce5e4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:12.956325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-240c9f63-17ed-4188-9902-fffbe0152e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:13.076288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40873f94ee43488fa08deffde98057a0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:13.077188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40873f94ee43488fa08deffde98057a0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:13.077883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40873f94ee43488fa08deffde98057a0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:13.101013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40873f94ee43488fa08deffde98057a0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:13.125026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 913/1817] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:13.125026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c9f63-17ed-4188-9902-fffbe0152e78 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:13.125026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-240c9f63-17ed-4188-9902-fffbe0152e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:13.147348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40873f94ee43488fa08deffde98057a0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:13.178799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 905/1818] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:12 2022] DELETE /identity/v3/users/40873f94ee43488fa08deffde98057a0 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:13.182045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:13.184322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:13.202116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:13.225763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c9f63-17ed-4188-9902-fffbe0152e78 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:13.417798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c1533-3427-4518-9863-720bea4d1c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:13.420124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c1533-3427-4518-9863-720bea4d1c5f service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:13.421403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c1533-3427-4518-9863-720bea4d1c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:13.422439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c1533-3427-4518-9863-720bea4d1c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:13.431623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-355c1533-3427-4518-9863-720bea4d1c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:13.451526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a834f9-d859-45ef-928d-4fedff3f2750 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:13.467362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdc22b-1f01-42a4-a5ff-1100ddf7fb96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:13.468477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdc22b-1f01-42a4-a5ff-1100ddf7fb96 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:13.469123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdc22b-1f01-42a4-a5ff-1100ddf7fb96 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:13.469538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdc22b-1f01-42a4-a5ff-1100ddf7fb96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:13.478200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6ecdc22b-1f01-42a4-a5ff-1100ddf7fb96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:13.505521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdc22b-1f01-42a4-a5ff-1100ddf7fb96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:13.509195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdc22b-1f01-42a4-a5ff-1100ddf7fb96 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:13.538525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 906/1819] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:13.539962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fac7b1-8ee2-49f9-9aaa-1a4f9479e8e3 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:13.540310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fac7b1-8ee2-49f9-9aaa-1a4f9479e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:13.540656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fac7b1-8ee2-49f9-9aaa-1a4f9479e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:13.580728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-03fac7b1-8ee2-49f9-9aaa-1a4f9479e8e3 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:13.585145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-03fac7b1-8ee2-49f9-9aaa-1a4f9479e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:13.596541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c1533-3427-4518-9863-720bea4d1c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:13.610921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c1533-3427-4518-9863-720bea4d1c5f service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:13.612673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 907/1820] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:13.613628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fac7b1-8ee2-49f9-9aaa-1a4f9479e8e3 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:13.615372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-03fac7b1-8ee2-49f9-9aaa-1a4f9479e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:13.639974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 914/1821] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:13.643624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fac7b1-8ee2-49f9-9aaa-1a4f9479e8e3 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:13.661085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:13.662219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:13.663992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:13.664381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:13.668381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:13.672399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c1533-3427-4518-9863-720bea4d1c5f service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:13.701442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:13.712769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c1533-3427-4518-9863-720bea4d1c5f service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:13.721853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d884fb5-392b-422f-bb9c-6408dfa0d800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:13.723081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d884fb5-392b-422f-bb9c-6408dfa0d800 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:13.723505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d884fb5-392b-422f-bb9c-6408dfa0d800 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:13.723793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d884fb5-392b-422f-bb9c-6408dfa0d800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:13.733966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:13.739866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:13.749142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d884fb5-392b-422f-bb9c-6408dfa0d800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:13.750615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d884fb5-392b-422f-bb9c-6408dfa0d800 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:13.783810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 908/1822] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:13.795666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 915/1823] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:14.130034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:14.490083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:14.701750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:14.707323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:14.745321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf01cb-ddba-4fef-8add-24bd27a0972d service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:14.771995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:14.772861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:14.775874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:14.776388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] PATH_INFO: `/v3/projects/b78e7675e9ca4a089f1de4534f12eda0` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:14.778313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78e7675e9ca4a089f1de4534f12eda0)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:14.787957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:15.027430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78e7675e9ca4a089f1de4534f12eda0', 'request_id': 'req-9f2b9d30-957d-4e5c-97be-3e5d52570b68'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.107765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78e7675e9ca4a089f1de4534f12eda0', 'request_id': 'req-9f2b9d30-957d-4e5c-97be-3e5d52570b68'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.120178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78e7675e9ca4a089f1de4534f12eda0', 'request_id': 'req-9f2b9d30-957d-4e5c-97be-3e5d52570b68'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.145765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] The token cache is being invalidate because project b78e7675e9ca4a089f1de4534f12eda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:15.148443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.148443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.151131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 909/1824] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:14 2022] DELETE /identity/v3/projects/b78e7675e9ca4a089f1de4534f12eda0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:15.156009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b28fa-48be-4948-bec8-fb5d1a73cfb2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:15.158226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b28fa-48be-4948-bec8-fb5d1a73cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:15.158662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b28fa-48be-4948-bec8-fb5d1a73cfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:15.215655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:15.217194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:15.230699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3e8b28fa-48be-4948-bec8-fb5d1a73cfb2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:15.240428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3e8b28fa-48be-4948-bec8-fb5d1a73cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:15.428743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b9d30-957d-4e5c-97be-3e5d52570b68 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:15.448429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 916/1825] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:15.449559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b28fa-48be-4948-bec8-fb5d1a73cfb2 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:15.452566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3e8b28fa-48be-4948-bec8-fb5d1a73cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:15.457539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:15.458216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:15.468432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:15.468432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] PATH_INFO: `/v3/projects/04f91f2a64b343fba591d78e28f2ae8a` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:15.468432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f91f2a64b343fba591d78e28f2ae8a)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:15.468432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:15.475320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b28fa-48be-4948-bec8-fb5d1a73cfb2 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:15.480827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:15.481552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:15.481838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:15.482234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] PATH_INFO: `/v3/projects/9ea2339352f54496bd4283d5a06e1250` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:15.483630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea2339352f54496bd4283d5a06e1250)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:15.486402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:15.491765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:15.650749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f91f2a64b343fba591d78e28f2ae8a', 'request_id': 'req-cc8955fc-422e-405e-ae62-c4061b2c78af'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.705953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea2339352f54496bd4283d5a06e1250', 'request_id': 'req-7412873b-0bec-45ff-a970-5fec53e9a934'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.720436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea2339352f54496bd4283d5a06e1250', 'request_id': 'req-7412873b-0bec-45ff-a970-5fec53e9a934'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.729891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f91f2a64b343fba591d78e28f2ae8a', 'request_id': 'req-cc8955fc-422e-405e-ae62-c4061b2c78af'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.776242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f91f2a64b343fba591d78e28f2ae8a', 'request_id': 'req-cc8955fc-422e-405e-ae62-c4061b2c78af'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.830186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] The token cache is being invalidate because project 04f91f2a64b343fba591d78e28f2ae8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:15.830544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.831338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-cc8955fc-422e-405e-ae62-c4061b2c78af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.838331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 910/1826] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:15 2022] DELETE /identity/v3/projects/04f91f2a64b343fba591d78e28f2ae8a => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:15.838331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e7ff-b657-4ce3-a1a6-928e29baee7d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:15.838331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e7ff-b657-4ce3-a1a6-928e29baee7d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:15.838331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5e7ff-b657-4ce3-a1a6-928e29baee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:15.882896 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-f0a5e7ff-b657-4ce3-a1a6-928e29baee7d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:15.884509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f0a5e7ff-b657-4ce3-a1a6-928e29baee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:15.889363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea2339352f54496bd4283d5a06e1250', 'request_id': 'req-7412873b-0bec-45ff-a970-5fec53e9a934'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.904470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] The token cache is being invalidate because project 9ea2339352f54496bd4283d5a06e1250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:15.904875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.905613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:15.910277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 917/1827] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:15 2022] DELETE /identity/v3/projects/9ea2339352f54496bd4283d5a06e1250 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:15.911411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:15.912945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:15.994108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 911/1828] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:15.995419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5e7ff-b657-4ce3-a1a6-928e29baee7d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:15.997200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f0a5e7ff-b657-4ce3-a1a6-928e29baee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:16.012246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412873b-0bec-45ff-a970-5fec53e9a934 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:16.018777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5e7ff-b657-4ce3-a1a6-928e29baee7d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:16.021829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:16.022113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:16.022372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:16.022747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] PATH_INFO: `/v3/users/3ec20ee12fc3407e8727ca9e28b6e08e` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:16.024123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec20ee12fc3407e8727ca9e28b6e08e)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:16.027050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:16.028627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:16.029891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:16.031006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:16.031496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] PATH_INFO: `/v3/users/2a574f9a01474f09bac228f95e3910d0` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:16.033245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a574f9a01474f09bac228f95e3910d0)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:16.036827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:16.266763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec20ee12fc3407e8727ca9e28b6e08e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.268081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec20ee12fc3407e8727ca9e28b6e08e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.268865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec20ee12fc3407e8727ca9e28b6e08e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.305565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a574f9a01474f09bac228f95e3910d0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.307010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a574f9a01474f09bac228f95e3910d0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.309551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a574f9a01474f09bac228f95e3910d0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.350492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec20ee12fc3407e8727ca9e28b6e08e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.366517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a574f9a01474f09bac228f95e3910d0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.373996 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec20ee12fc3407e8727ca9e28b6e08e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.388152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 918/1829] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:15 2022] DELETE /identity/v3/users/3ec20ee12fc3407e8727ca9e28b6e08e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:16.389250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:16.392231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:16.426158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-41443b5f-070f-49f6-866d-2af7bdf6b6b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a574f9a01474f09bac228f95e3910d0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:16.433155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:16.455911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 912/1830] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:15 2022] DELETE /identity/v3/users/2a574f9a01474f09bac228f95e3910d0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:16.457734 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8c860-9f8e-41dd-bc65-57437a0b9b68 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:16.458162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8c860-9f8e-41dd-bc65-57437a0b9b68 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:16.458640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8c860-9f8e-41dd-bc65-57437a0b9b68 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:16.462608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 913/1831] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:55:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:16.532421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cdc6a-7e2b-481f-9937-f4989740fd3b None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:16.532712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cdc6a-7e2b-481f-9937-f4989740fd3b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:16.532990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cdc6a-7e2b-481f-9937-f4989740fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:16.554973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fb8ef-1ada-4529-9177-f42242efd414 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:16.564843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:16.572927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-f98cdc6a-7e2b-481f-9937-f4989740fd3b None None] MFA Rules not processed for user `36bd5aef3c034c41be036c4cc9eed376`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:16.574183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f98cdc6a-7e2b-481f-9937-f4989740fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:16.731244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:16.732089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:16.732382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:16.732875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:16.733690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:16.734639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:16.736832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:16.777786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 919/1832] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:16.783736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 914/1833] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:55:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:16.784680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:16.786564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:16.803524 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af281f4b-040b-4f8a-893a-ab85cae3993e admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:16.822392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a3c24-316e-420d-9bea-122f9b893e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:16.823342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a3c24-316e-420d-9bea-122f9b893e9a admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:16.825429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a3c24-316e-420d-9bea-122f9b893e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:16.825816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a3c24-316e-420d-9bea-122f9b893e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:16.826572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a3c24-316e-420d-9bea-122f9b893e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:16.831613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a3c24-316e-420d-9bea-122f9b893e9a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:16.861934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cdc6a-7e2b-481f-9937-f4989740fd3b None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:16.863773 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f98cdc6a-7e2b-481f-9937-f4989740fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:16.884810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cdc6a-7e2b-481f-9937-f4989740fd3b None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:16.902258 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800746-23e9-4e9d-9b09-3fd55a620b80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:16.903764 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800746-23e9-4e9d-9b09-3fd55a620b80 service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:16.909936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800746-23e9-4e9d-9b09-3fd55a620b80 service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:16.910372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80800746-23e9-4e9d-9b09-3fd55a620b80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:16.927987 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80800746-23e9-4e9d-9b09-3fd55a620b80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:16.929738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80800746-23e9-4e9d-9b09-3fd55a620b80 service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:16.958129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 915/1834] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:16.982851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:16.996778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 920/1835] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:16 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:16.998372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800746-23e9-4e9d-9b09-3fd55a620b80 service placement] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:17.013837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80800746-23e9-4e9d-9b09-3fd55a620b80 service placement] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:17.119834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:17.148626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:17.154541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb64bf-fe8b-4829-9108-d0811d496315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:17.155197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb64bf-fe8b-4829-9108-d0811d496315 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:17.157090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb64bf-fe8b-4829-9108-d0811d496315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:17.157090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb64bf-fe8b-4829-9108-d0811d496315 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:17.157090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb64bf-fe8b-4829-9108-d0811d496315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:17.158654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb64bf-fe8b-4829-9108-d0811d496315 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:17.270075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 916/1836] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:16 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:17.274150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a3c24-316e-420d-9bea-122f9b893e9a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:17.288586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a3c24-316e-420d-9bea-122f9b893e9a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:17.301072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd355670-9c6f-468b-9a76-5d107dedd03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:17.301745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd355670-9c6f-468b-9a76-5d107dedd03f admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:17.302002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd355670-9c6f-468b-9a76-5d107dedd03f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:17.302258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd355670-9c6f-468b-9a76-5d107dedd03f admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:17.303512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd355670-9c6f-468b-9a76-5d107dedd03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:17.305160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd355670-9c6f-468b-9a76-5d107dedd03f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:17.333347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 921/1837] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:17.333502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb64bf-fe8b-4829-9108-d0811d496315 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:17.345688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb64bf-fe8b-4829-9108-d0811d496315 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:17.347496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:17.351820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548746a-bbcb-4beb-8b19-315280cb006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:17.356168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548746a-bbcb-4beb-8b19-315280cb006d admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:17.356168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548746a-bbcb-4beb-8b19-315280cb006d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:17.356168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548746a-bbcb-4beb-8b19-315280cb006d admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:17.359392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548746a-bbcb-4beb-8b19-315280cb006d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:17.361260 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548746a-bbcb-4beb-8b19-315280cb006d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:17.390118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd355670-9c6f-468b-9a76-5d107dedd03f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:17.403652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd355670-9c6f-468b-9a76-5d107dedd03f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:17.403847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 917/1838] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:17.415497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b857c-c650-4466-9397-d52493b7c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:17.416247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b857c-c650-4466-9397-d52493b7c311 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:17.416592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b857c-c650-4466-9397-d52493b7c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:17.416934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b857c-c650-4466-9397-d52493b7c311 admin admin] PATH_INFO: `/v3/projects/01451fcbb0cd4624b8c83a85ee7b4e0c/users/04e14b1f2da242299dc8b3736ac6872b/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:17.454926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b857c-c650-4466-9397-d52493b7c311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01451fcbb0cd4624b8c83a85ee7b4e0c, user_id=04e14b1f2da242299dc8b3736ac6872b, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:17.460297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b857c-c650-4466-9397-d52493b7c311 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:17.612733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 922/1839] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:17 2022] PUT /identity/v3/projects/01451fcbb0cd4624b8c83a85ee7b4e0c/users/04e14b1f2da242299dc8b3736ac6872b/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:17.616182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadadbc1-3172-453c-904b-a258b6469dbe None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:17.616813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadadbc1-3172-453c-904b-a258b6469dbe None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:17.617041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadadbc1-3172-453c-904b-a258b6469dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:17.652663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:17.677158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-cadadbc1-3172-453c-904b-a258b6469dbe None None] MFA Rules not processed for user `04e14b1f2da242299dc8b3736ac6872b`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:17.678509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cadadbc1-3172-453c-904b-a258b6469dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:17.799178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 918/1840] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:17.817449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b857c-c650-4466-9397-d52493b7c311 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:17.819837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-983b857c-c650-4466-9397-d52493b7c311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:17.961784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b857c-c650-4466-9397-d52493b7c311 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:17.967521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08397e1-6b55-4a3e-9459-065fa9c34ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:17.976439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08397e1-6b55-4a3e-9459-065fa9c34ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:17.976730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08397e1-6b55-4a3e-9459-065fa9c34ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:17.977313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08397e1-6b55-4a3e-9459-065fa9c34ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:17.990079 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08397e1-6b55-4a3e-9459-065fa9c34ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:17.993853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08397e1-6b55-4a3e-9459-065fa9c34ca0 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:18.031662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 923/1841] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:19.125648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:19.168954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08397e1-6b55-4a3e-9459-065fa9c34ca0 service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:19.170421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadadbc1-3172-453c-904b-a258b6469dbe None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:19.174470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e08397e1-6b55-4a3e-9459-065fa9c34ca0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:19.176888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cadadbc1-3172-453c-904b-a258b6469dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:19.285176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadadbc1-3172-453c-904b-a258b6469dbe None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:19.290455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:19.302099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:19.302099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.302099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.302099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] PATH_INFO: `/v3/projects/451fbee466dc4d099158086618c1b8a4` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.302594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451fbee466dc4d099158086618c1b8a4)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:19.303033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:19.349347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08397e1-6b55-4a3e-9459-065fa9c34ca0 service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:19.354227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:19.354880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.355170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.355478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] PATH_INFO: `/v3/projects/4636d1bc38e54283a5cd6e0500b53f18` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.360089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4636d1bc38e54283a5cd6e0500b53f18)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:19.362254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:19.477842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451fbee466dc4d099158086618c1b8a4', 'request_id': 'req-705d19ab-edfa-40a8-a36a-41a4bba92a59'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.502238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4636d1bc38e54283a5cd6e0500b53f18', 'request_id': 'req-4eb57906-4931-4e38-8b4b-8d4ae985a98e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.509929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4636d1bc38e54283a5cd6e0500b53f18', 'request_id': 'req-4eb57906-4931-4e38-8b4b-8d4ae985a98e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.553948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451fbee466dc4d099158086618c1b8a4', 'request_id': 'req-705d19ab-edfa-40a8-a36a-41a4bba92a59'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.563400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451fbee466dc4d099158086618c1b8a4', 'request_id': 'req-705d19ab-edfa-40a8-a36a-41a4bba92a59'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.576508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] The token cache is being invalidate because project 451fbee466dc4d099158086618c1b8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:19.576789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.577630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.579276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 919/1842] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:19 2022] DELETE /identity/v3/projects/451fbee466dc4d099158086618c1b8a4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:19.580271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:19.581869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:19.653643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d19ab-edfa-40a8-a36a-41a4bba92a59 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:19.689979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4636d1bc38e54283a5cd6e0500b53f18', 'request_id': 'req-4eb57906-4931-4e38-8b4b-8d4ae985a98e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.739213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] The token cache is being invalidate because project 4636d1bc38e54283a5cd6e0500b53f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:19.739213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.739213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4eb57906-4931-4e38-8b4b-8d4ae985a98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:19.739213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 924/1843] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:19 2022] DELETE /identity/v3/projects/4636d1bc38e54283a5cd6e0500b53f18 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:19.739726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cfaf1-4157-46ca-8cc4-4c6c2419718a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.740967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cfaf1-4157-46ca-8cc4-4c6c2419718a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.741420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cfaf1-4157-46ca-8cc4-4c6c2419718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.762865 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:19.762865 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.762865 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.762865 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] PATH_INFO: `/v3/users/de6bb3407c624210912f6e283a9e617b` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.763177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6bb3407c624210912f6e283a9e617b)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:19.763177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:19.775764 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-265cfaf1-4157-46ca-8cc4-4c6c2419718a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:19.780606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-265cfaf1-4157-46ca-8cc4-4c6c2419718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:19.800036 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 925/1844] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:19.801344 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc5b1-f545-44ce-9924-0b3bbf65fbb5 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.801615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc5b1-f545-44ce-9924-0b3bbf65fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.801911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc5b1-f545-44ce-9924-0b3bbf65fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.825538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-91efc5b1-f545-44ce-9924-0b3bbf65fbb5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:19.836895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-91efc5b1-f545-44ce-9924-0b3bbf65fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:19.836895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 926/1845] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:19.837694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb6660-3afc-4158-9ca2-77872e3a9d54 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.837984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb6660-3afc-4158-9ca2-77872e3a9d54 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.838263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb6660-3afc-4158-9ca2-77872e3a9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.857954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-cecb6660-3afc-4158-9ca2-77872e3a9d54 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:19.859697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cecb6660-3afc-4158-9ca2-77872e3a9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:19.867921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 927/1846] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:19.869021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596637d-d4e4-4604-ac04-fef3fc2510bc None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.869299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596637d-d4e4-4604-ac04-fef3fc2510bc None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.869569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596637d-d4e4-4604-ac04-fef3fc2510bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.890610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7596637d-d4e4-4604-ac04-fef3fc2510bc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:19.894275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7596637d-d4e4-4604-ac04-fef3fc2510bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:19.900836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 928/1847] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:19.901689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596637d-d4e4-4604-ac04-fef3fc2510bc None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:19.911216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596637d-d4e4-4604-ac04-fef3fc2510bc None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:19.917006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fce2d-10de-461d-9e3d-6c7b5a699e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:19.917585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fce2d-10de-461d-9e3d-6c7b5a699e35 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.917864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fce2d-10de-461d-9e3d-6c7b5a699e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.918141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fce2d-10de-461d-9e3d-6c7b5a699e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.918787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55fce2d-10de-461d-9e3d-6c7b5a699e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:19.919071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55fce2d-10de-461d-9e3d-6c7b5a699e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:19.920665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55fce2d-10de-461d-9e3d-6c7b5a699e35 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:19.936355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 929/1848] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:19.937604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fce2d-10de-461d-9e3d-6c7b5a699e35 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:19.948087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fce2d-10de-461d-9e3d-6c7b5a699e35 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:19.952686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35a658-994e-4747-8013-a5593dddad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:19.959924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a658-994e-4747-8013-a5593dddad57 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.959924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a658-994e-4747-8013-a5593dddad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.959924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a658-994e-4747-8013-a5593dddad57 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.959924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a658-994e-4747-8013-a5593dddad57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:19.959924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a658-994e-4747-8013-a5593dddad57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:19.959924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a658-994e-4747-8013-a5593dddad57 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:19.969811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 930/1849] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:19.970725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35a658-994e-4747-8013-a5593dddad57 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:19.982306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35a658-994e-4747-8013-a5593dddad57 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:19.986962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cccf65-8e72-41ea-8928-abfd99b46a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:19.987620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cccf65-8e72-41ea-8928-abfd99b46a76 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:19.987914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cccf65-8e72-41ea-8928-abfd99b46a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:19.988198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cccf65-8e72-41ea-8928-abfd99b46a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:19.988938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cccf65-8e72-41ea-8928-abfd99b46a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:19.991640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cccf65-8e72-41ea-8928-abfd99b46a76 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.009638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6bb3407c624210912f6e283a9e617b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.010446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6bb3407c624210912f6e283a9e617b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.011188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6bb3407c624210912f6e283a9e617b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.023672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6bb3407c624210912f6e283a9e617b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.090712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6bb3407c624210912f6e283a9e617b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.101238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 931/1850] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:19 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:20.102020 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cccf65-8e72-41ea-8928-abfd99b46a76 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.103872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-34cccf65-8e72-41ea-8928-abfd99b46a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:20.106144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 920/1851] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:19 2022] DELETE /identity/v3/users/de6bb3407c624210912f6e283a9e617b => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:20.106773 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.108130 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:20.189402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cccf65-8e72-41ea-8928-abfd99b46a76 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.198187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d6bed-e63f-41cf-9df2-b55227a6ab96 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.202932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf7e0d-a1fa-4d6e-b0ba-ea49091c3d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.202932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf7e0d-a1fa-4d6e-b0ba-ea49091c3d46 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.202932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf7e0d-a1fa-4d6e-b0ba-ea49091c3d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.202932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf7e0d-a1fa-4d6e-b0ba-ea49091c3d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.203531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf7e0d-a1fa-4d6e-b0ba-ea49091c3d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.204982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4384cb-5f35-4054-a9e8-60cf1a73d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.205782 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4384cb-5f35-4054-a9e8-60cf1a73d0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.206222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4384cb-5f35-4054-a9e8-60cf1a73d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.206815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf7e0d-a1fa-4d6e-b0ba-ea49091c3d46 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.206948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4384cb-5f35-4054-a9e8-60cf1a73d0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.209426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4384cb-5f35-4054-a9e8-60cf1a73d0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.211786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4384cb-5f35-4054-a9e8-60cf1a73d0a9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.289945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 921/1852] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:20 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:20.295333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4384cb-5f35-4054-a9e8-60cf1a73d0a9 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.305227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4384cb-5f35-4054-a9e8-60cf1a73d0a9 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.309705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b17739-369a-4a44-9ce7-a19409ccb936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.310326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b17739-369a-4a44-9ce7-a19409ccb936 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.310652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b17739-369a-4a44-9ce7-a19409ccb936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.311671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b17739-369a-4a44-9ce7-a19409ccb936 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.312589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b17739-369a-4a44-9ce7-a19409ccb936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.314185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b17739-369a-4a44-9ce7-a19409ccb936 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.322038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 932/1853] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:20 2022] POST /identity/v3/projects => generated 407 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:20.325309 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf7e0d-a1fa-4d6e-b0ba-ea49091c3d46 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.328632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 922/1854] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:20.332336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b17739-369a-4a44-9ce7-a19409ccb936 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.342643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b17739-369a-4a44-9ce7-a19409ccb936 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.403065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf7e0d-a1fa-4d6e-b0ba-ea49091c3d46 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.408104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975197-30c2-468e-89f3-f0484740207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.408669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975197-30c2-468e-89f3-f0484740207f admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.408956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975197-30c2-468e-89f3-f0484740207f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.409244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975197-30c2-468e-89f3-f0484740207f admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.409886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d975197-30c2-468e-89f3-f0484740207f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.412104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d975197-30c2-468e-89f3-f0484740207f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.416463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a1351-13a5-4467-9c6b-7f8dfdeb67cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.417079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a1351-13a5-4467-9c6b-7f8dfdeb67cd admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.417492 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a1351-13a5-4467-9c6b-7f8dfdeb67cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.417772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a1351-13a5-4467-9c6b-7f8dfdeb67cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.418421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a1351-13a5-4467-9c6b-7f8dfdeb67cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.420150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a1351-13a5-4467-9c6b-7f8dfdeb67cd admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.431882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 923/1855] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:20.433095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a1351-13a5-4467-9c6b-7f8dfdeb67cd admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.434842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d84a1351-13a5-4467-9c6b-7f8dfdeb67cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:20.448779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a1351-13a5-4467-9c6b-7f8dfdeb67cd admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.454145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.454837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.455149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.455454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] PATH_INFO: `/v3/projects/1f978fa2d7a74a23bf947566be5a5a48` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.456570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f978fa2d7a74a23bf947566be5a5a48)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.459930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.466941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 933/1856] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:20 2022] POST /identity/v3/users => generated 304 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:20.467602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975197-30c2-468e-89f3-f0484740207f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.478828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975197-30c2-468e-89f3-f0484740207f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.483636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef64171-d331-443e-a95b-47b38d2b6d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.484380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef64171-d331-443e-a95b-47b38d2b6d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.484612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef64171-d331-443e-a95b-47b38d2b6d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.484887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef64171-d331-443e-a95b-47b38d2b6d67 admin admin] PATH_INFO: `/v3/projects/47d5c93718bb41048a9d2156d9d38c27/users/559cfd46c40248ae9ae0401026819e73/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.500962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef64171-d331-443e-a95b-47b38d2b6d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d5c93718bb41048a9d2156d9d38c27, user_id=559cfd46c40248ae9ae0401026819e73, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.503632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef64171-d331-443e-a95b-47b38d2b6d67 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.588199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 934/1857] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:20 2022] PUT /identity/v3/projects/47d5c93718bb41048a9d2156d9d38c27/users/559cfd46c40248ae9ae0401026819e73/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:20.589210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef64171-d331-443e-a95b-47b38d2b6d67 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.610573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f978fa2d7a74a23bf947566be5a5a48', 'request_id': 'req-f53f1e97-989c-4c88-9a15-69af2993a46d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.657511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef64171-d331-443e-a95b-47b38d2b6d67 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.671859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f978fa2d7a74a23bf947566be5a5a48', 'request_id': 'req-f53f1e97-989c-4c88-9a15-69af2993a46d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.679755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f978fa2d7a74a23bf947566be5a5a48', 'request_id': 'req-f53f1e97-989c-4c88-9a15-69af2993a46d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.692003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] The token cache is being invalidate because project 1f978fa2d7a74a23bf947566be5a5a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:20.692291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.692945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f53f1e97-989c-4c88-9a15-69af2993a46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:20.698288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 924/1858] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:20 2022] DELETE /identity/v3/projects/1f978fa2d7a74a23bf947566be5a5a48 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:20.698288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bb0d7-490a-405d-baf0-b1926cebb913 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.698288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bb0d7-490a-405d-baf0-b1926cebb913 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.698288 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bb0d7-490a-405d-baf0-b1926cebb913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.714965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005ece4-a83b-4e92-b2a1-55b1cac764ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.715612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ece4-a83b-4e92-b2a1-55b1cac764ff admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.715896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ece4-a83b-4e92-b2a1-55b1cac764ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.716174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ece4-a83b-4e92-b2a1-55b1cac764ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.716816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005ece4-a83b-4e92-b2a1-55b1cac764ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.718407 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005ece4-a83b-4e92-b2a1-55b1cac764ff admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.726782 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a20bb0d7-490a-405d-baf0-b1926cebb913 None None] MFA Rules not processed for user `559cfd46c40248ae9ae0401026819e73`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:20.728240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a20bb0d7-490a-405d-baf0-b1926cebb913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:20.728818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 935/1859] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:20.732350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005ece4-a83b-4e92-b2a1-55b1cac764ff admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.732350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3005ece4-a83b-4e92-b2a1-55b1cac764ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:20.744989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005ece4-a83b-4e92-b2a1-55b1cac764ff admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.749894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.750530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.750958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.751072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] PATH_INFO: `/v3/users/af2f801fcb1444b299cf0fec0ce5e4d4` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.752479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2f801fcb1444b299cf0fec0ce5e4d4)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.754391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.758552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:20.805566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:20.821061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 925/1860] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:20.821061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bb0d7-490a-405d-baf0-b1926cebb913 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.821061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a20bb0d7-490a-405d-baf0-b1926cebb913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:20.838317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bb0d7-490a-405d-baf0-b1926cebb913 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.843111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2515-738d-4a3c-b270-99a0108ceb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.843676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2515-738d-4a3c-b270-99a0108ceb96 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.843956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2515-738d-4a3c-b270-99a0108ceb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.844236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2515-738d-4a3c-b270-99a0108ceb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.844996 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df2515-738d-4a3c-b270-99a0108ceb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.846931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df2515-738d-4a3c-b270-99a0108ceb96 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:20.869203 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 926/1861] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:20.869203 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2515-738d-4a3c-b270-99a0108ceb96 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:20.875810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a4df2515-738d-4a3c-b270-99a0108ceb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:20.895365 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2515-738d-4a3c-b270-99a0108ceb96 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:20.901377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177e567-4f81-4017-90ac-af7a9745ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:20.901989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177e567-4f81-4017-90ac-af7a9745ab67 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.902354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177e567-4f81-4017-90ac-af7a9745ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.903355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177e567-4f81-4017-90ac-af7a9745ab67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.903355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177e567-4f81-4017-90ac-af7a9745ab67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:20.905673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177e567-4f81-4017-90ac-af7a9745ab67 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.064125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2f801fcb1444b299cf0fec0ce5e4d4'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.064883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2f801fcb1444b299cf0fec0ce5e4d4'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.065564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2f801fcb1444b299cf0fec0ce5e4d4'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.115934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 927/1862] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:20 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:21.116117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177e567-4f81-4017-90ac-af7a9745ab67 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:21.120702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4177e567-4f81-4017-90ac-af7a9745ab67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:21.135060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2f801fcb1444b299cf0fec0ce5e4d4'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.148382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2f801fcb1444b299cf0fec0ce5e4d4'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.168218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 936/1863] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:20 2022] DELETE /identity/v3/users/af2f801fcb1444b299cf0fec0ce5e4d4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:21.169560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:21.173033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:21.192979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177e567-4f81-4017-90ac-af7a9745ab67 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:21.249288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e845-28d4-41c6-8268-a2089bb99b90 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:21.254944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6616968-5701-4134-955a-8a0551d80d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:21.255957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6616968-5701-4134-955a-8a0551d80d8c admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.256484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6616968-5701-4134-955a-8a0551d80d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.256977 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6616968-5701-4134-955a-8a0551d80d8c admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.257735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6616968-5701-4134-955a-8a0551d80d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:21.260178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6616968-5701-4134-955a-8a0551d80d8c admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.265308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f8989-c3b3-4039-8414-42ac316b51fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:21.265308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f8989-c3b3-4039-8414-42ac316b51fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.265308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f8989-c3b3-4039-8414-42ac316b51fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.265308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f8989-c3b3-4039-8414-42ac316b51fa admin admin] PATH_INFO: `/v3/projects/ca1570df05774aef937031ae13aab295/users/6db7a7a656d2490bbbdc2d40cd10a926/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.282689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f8989-c3b3-4039-8414-42ac316b51fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1570df05774aef937031ae13aab295, user_id=6db7a7a656d2490bbbdc2d40cd10a926, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:21.285803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f8989-c3b3-4039-8414-42ac316b51fa admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.343322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 937/1864] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:21 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:21.347768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6616968-5701-4134-955a-8a0551d80d8c admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:21.357951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6616968-5701-4134-955a-8a0551d80d8c admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:21.363955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cfbde-4eca-4ac4-bcd8-84d5af49f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:21.369312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cfbde-4eca-4ac4-bcd8-84d5af49f2af admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.369312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cfbde-4eca-4ac4-bcd8-84d5af49f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.369312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cfbde-4eca-4ac4-bcd8-84d5af49f2af admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.369312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cfbde-4eca-4ac4-bcd8-84d5af49f2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:21.369312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cfbde-4eca-4ac4-bcd8-84d5af49f2af admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.377896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 938/1865] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:21.382552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cfbde-4eca-4ac4-bcd8-84d5af49f2af admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:21.387930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 928/1866] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:21 2022] PUT /identity/v3/projects/ca1570df05774aef937031ae13aab295/users/6db7a7a656d2490bbbdc2d40cd10a926/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:21.392250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cfbde-4eca-4ac4-bcd8-84d5af49f2af admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:21.402822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb9fe-78b5-44bd-88c4-1ddbb2803045 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.403627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb9fe-78b5-44bd-88c4-1ddbb2803045 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.404117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadb9fe-78b5-44bd-88c4-1ddbb2803045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.461762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-5aadb9fe-78b5-44bd-88c4-1ddbb2803045 None None] MFA Rules not processed for user `6db7a7a656d2490bbbdc2d40cd10a926`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:21.461762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5aadb9fe-78b5-44bd-88c4-1ddbb2803045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:21.470800 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d0045-96a0-4e85-9f38-41b23084e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:21.471597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d0045-96a0-4e85-9f38-41b23084e098 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.472238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d0045-96a0-4e85-9f38-41b23084e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.472593 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d0045-96a0-4e85-9f38-41b23084e098 admin admin] PATH_INFO: `/v3/projects/594f5e5e0238432eafcbe8122efa8127/users/262ef8f9670841dbbe755614175cdc17/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.490989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d0045-96a0-4e85-9f38-41b23084e098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594f5e5e0238432eafcbe8122efa8127, user_id=262ef8f9670841dbbe755614175cdc17, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:21.495787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d0045-96a0-4e85-9f38-41b23084e098 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.543226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 929/1867] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:21 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:21.544240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb9fe-78b5-44bd-88c4-1ddbb2803045 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:21.545498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5aadb9fe-78b5-44bd-88c4-1ddbb2803045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:21.561862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadb9fe-78b5-44bd-88c4-1ddbb2803045 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:21.566794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:21.567464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.567755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.568162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] PATH_INFO: `/v3/projects/f53baa382eb3494d8281c10264030a35` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.569369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53baa382eb3494d8281c10264030a35)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:21.571313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.581143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 939/1868] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:21 2022] PUT /identity/v3/projects/594f5e5e0238432eafcbe8122efa8127/users/262ef8f9670841dbbe755614175cdc17/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:21.581874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d0045-96a0-4e85-9f38-41b23084e098 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:21.649898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d0045-96a0-4e85-9f38-41b23084e098 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:21.654605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ffbf3-059a-4a41-a7d1-f07705e71c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:21.655249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ffbf3-059a-4a41-a7d1-f07705e71c9b admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.655565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ffbf3-059a-4a41-a7d1-f07705e71c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.655840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ffbf3-059a-4a41-a7d1-f07705e71c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.656489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ffbf3-059a-4a41-a7d1-f07705e71c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:21.658390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ffbf3-059a-4a41-a7d1-f07705e71c9b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.707486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53baa382eb3494d8281c10264030a35', 'request_id': 'req-c93deb46-b7b5-4af5-ad1d-29c923f46a66'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.785885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53baa382eb3494d8281c10264030a35', 'request_id': 'req-c93deb46-b7b5-4af5-ad1d-29c923f46a66'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.789965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:21.795560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 940/1869] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:21 2022] POST /identity/v3/projects => generated 407 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:21.795560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ffbf3-059a-4a41-a7d1-f07705e71c9b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:21.796485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53baa382eb3494d8281c10264030a35', 'request_id': 'req-c93deb46-b7b5-4af5-ad1d-29c923f46a66'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.807632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] The token cache is being invalidate because project f53baa382eb3494d8281c10264030a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:21.807920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.808799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:21.810309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 930/1870] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:21 2022] DELETE /identity/v3/projects/f53baa382eb3494d8281c10264030a35 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:21.811038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:21.812632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:21.864224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ffbf3-059a-4a41-a7d1-f07705e71c9b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:21.871900 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239dab-e213-4bf8-9a8f-d466d1598255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:21.872548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239dab-e213-4bf8-9a8f-d466d1598255 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.873108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239dab-e213-4bf8-9a8f-d466d1598255 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.874479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:21.874930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239dab-e213-4bf8-9a8f-d466d1598255 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.875627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9239dab-e213-4bf8-9a8f-d466d1598255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:21.877673 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9239dab-e213-4bf8-9a8f-d466d1598255 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.880701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93deb46-b7b5-4af5-ad1d-29c923f46a66 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:21.885681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a886fe9-709f-4c53-b1fe-d31b7fa86dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:21.886290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a886fe9-709f-4c53-b1fe-d31b7fa86dff admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.886577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a886fe9-709f-4c53-b1fe-d31b7fa86dff admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.886895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a886fe9-709f-4c53-b1fe-d31b7fa86dff admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.887552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a886fe9-709f-4c53-b1fe-d31b7fa86dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:21.888468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 941/1871] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:21.889609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a886fe9-709f-4c53-b1fe-d31b7fa86dff admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.889727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e57c-96b3-4cba-b488-13f1fa7ac6c7 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.890004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e57c-96b3-4cba-b488-13f1fa7ac6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.890296 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e57c-96b3-4cba-b488-13f1fa7ac6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.910616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-70c7e57c-96b3-4cba-b488-13f1fa7ac6c7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:21.912626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-70c7e57c-96b3-4cba-b488-13f1fa7ac6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:21.921094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 942/1872] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:21.921972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7e57c-96b3-4cba-b488-13f1fa7ac6c7 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:21.923341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-70c7e57c-96b3-4cba-b488-13f1fa7ac6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:21.935479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7e57c-96b3-4cba-b488-13f1fa7ac6c7 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:21.940655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da364e06-6d1e-418c-86fc-68b5d0ab3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:21.941568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364e06-6d1e-418c-86fc-68b5d0ab3ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.942108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364e06-6d1e-418c-86fc-68b5d0ab3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.942534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364e06-6d1e-418c-86fc-68b5d0ab3ed1 admin admin] PATH_INFO: `/v3/projects/594f5e5e0238432eafcbe8122efa8127/users/262ef8f9670841dbbe755614175cdc17/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.944905 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da364e06-6d1e-418c-86fc-68b5d0ab3ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594f5e5e0238432eafcbe8122efa8127, user_id=262ef8f9670841dbbe755614175cdc17, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:21.947750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da364e06-6d1e-418c-86fc-68b5d0ab3ed1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:21.967417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 943/1873] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:21 2022] PUT /identity/v3/projects/594f5e5e0238432eafcbe8122efa8127/users/262ef8f9670841dbbe755614175cdc17/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:21.967417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d98674-0185-4cf1-8a26-059ab61fa0b4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:21.967417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d98674-0185-4cf1-8a26-059ab61fa0b4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:21.967417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d98674-0185-4cf1-8a26-059ab61fa0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:21.991238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d9d98674-0185-4cf1-8a26-059ab61fa0b4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:21.992472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d9d98674-0185-4cf1-8a26-059ab61fa0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:22.027667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 931/1874] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:21 2022] POST /identity/v3/users => generated 310 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:22.033038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79dff4-4f81-4ab8-9c91-4181314095ed None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.035045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79dff4-4f81-4ab8-9c91-4181314095ed None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.037323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79dff4-4f81-4ab8-9c91-4181314095ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.083357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 944/1875] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:22.085085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d98674-0185-4cf1-8a26-059ab61fa0b4 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.097775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d98674-0185-4cf1-8a26-059ab61fa0b4 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.102861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ca79dff4-4f81-4ab8-9c91-4181314095ed None None] MFA Rules not processed for user `262ef8f9670841dbbe755614175cdc17`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:22.104500 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ca79dff4-4f81-4ab8-9c91-4181314095ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:22.104639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891eddd-7abc-44a1-a3bd-abbc0af971e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.105244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891eddd-7abc-44a1-a3bd-abbc0af971e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.105604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891eddd-7abc-44a1-a3bd-abbc0af971e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.105949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891eddd-7abc-44a1-a3bd-abbc0af971e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.106655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891eddd-7abc-44a1-a3bd-abbc0af971e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.108353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891eddd-7abc-44a1-a3bd-abbc0af971e7 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.125353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 945/1876] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:22.125353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891eddd-7abc-44a1-a3bd-abbc0af971e7 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.139175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891eddd-7abc-44a1-a3bd-abbc0af971e7 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.144848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620496ea-f5d1-4776-8937-f646e4dd711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.150654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620496ea-f5d1-4776-8937-f646e4dd711a admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.151468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620496ea-f5d1-4776-8937-f646e4dd711a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.151468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620496ea-f5d1-4776-8937-f646e4dd711a admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.152154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620496ea-f5d1-4776-8937-f646e4dd711a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:22.152464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620496ea-f5d1-4776-8937-f646e4dd711a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.154120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620496ea-f5d1-4776-8937-f646e4dd711a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.179909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 946/1877] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:22.181083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620496ea-f5d1-4776-8937-f646e4dd711a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.194182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620496ea-f5d1-4776-8937-f646e4dd711a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.199442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689dd7c-2b19-49c9-a71f-1fd626e8dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.200242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689dd7c-2b19-49c9-a71f-1fd626e8dc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.200632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689dd7c-2b19-49c9-a71f-1fd626e8dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.201009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689dd7c-2b19-49c9-a71f-1fd626e8dc95 admin admin] PATH_INFO: `/v3/projects/47b9e5d4e0c248b3b60bc1a03ee0cce4/users/9d026d82b1604249b2d59f4890b98db6/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.204473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 932/1878] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:22.205406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79dff4-4f81-4ab8-9c91-4181314095ed None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.221289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689dd7c-2b19-49c9-a71f-1fd626e8dc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b9e5d4e0c248b3b60bc1a03ee0cce4, user_id=9d026d82b1604249b2d59f4890b98db6, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.222061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79dff4-4f81-4ab8-9c91-4181314095ed None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.224280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689dd7c-2b19-49c9-a71f-1fd626e8dc95 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.227468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03824e1-0bfd-4faf-bd6b-288de96936f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.228166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03824e1-0bfd-4faf-bd6b-288de96936f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.228502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03824e1-0bfd-4faf-bd6b-288de96936f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.228784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03824e1-0bfd-4faf-bd6b-288de96936f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.229413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03824e1-0bfd-4faf-bd6b-288de96936f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.231600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03824e1-0bfd-4faf-bd6b-288de96936f5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.318709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 947/1879] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:22 2022] PUT /identity/v3/projects/47b9e5d4e0c248b3b60bc1a03ee0cce4/users/9d026d82b1604249b2d59f4890b98db6/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:22.319676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689dd7c-2b19-49c9-a71f-1fd626e8dc95 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.321836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a689dd7c-2b19-49c9-a71f-1fd626e8dc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:22.378643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689dd7c-2b19-49c9-a71f-1fd626e8dc95 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.383171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 933/1880] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:22 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:22.383680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f327f3-9134-44e9-b156-84dc6f50c4e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.384198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03824e1-0bfd-4faf-bd6b-288de96936f5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.384426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f327f3-9134-44e9-b156-84dc6f50c4e0 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.384811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f327f3-9134-44e9-b156-84dc6f50c4e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.385292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f327f3-9134-44e9-b156-84dc6f50c4e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.449943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03824e1-0bfd-4faf-bd6b-288de96936f5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.450426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f327f3-9134-44e9-b156-84dc6f50c4e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.451918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f327f3-9134-44e9-b156-84dc6f50c4e0 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.455548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caeea7-7c50-40e3-a7ac-e99843da1a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.456157 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caeea7-7c50-40e3-a7ac-e99843da1a0c admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.456447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caeea7-7c50-40e3-a7ac-e99843da1a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.456723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caeea7-7c50-40e3-a7ac-e99843da1a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.457371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caeea7-7c50-40e3-a7ac-e99843da1a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.459812 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3caeea7-7c50-40e3-a7ac-e99843da1a0c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.462477 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 948/1881] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:22.463264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f327f3-9134-44e9-b156-84dc6f50c4e0 service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.470656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 934/1882] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:22.475935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caeea7-7c50-40e3-a7ac-e99843da1a0c admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.486692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3caeea7-7c50-40e3-a7ac-e99843da1a0c admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.492000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7bd5c-aae2-44f4-a0f5-38d3990b9cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.492817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7bd5c-aae2-44f4-a0f5-38d3990b9cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.493096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7bd5c-aae2-44f4-a0f5-38d3990b9cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.493493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7bd5c-aae2-44f4-a0f5-38d3990b9cfe admin admin] PATH_INFO: `/v3/projects/47b9e5d4e0c248b3b60bc1a03ee0cce4/users/9d026d82b1604249b2d59f4890b98db6/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.495474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7bd5c-aae2-44f4-a0f5-38d3990b9cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b9e5d4e0c248b3b60bc1a03ee0cce4, user_id=9d026d82b1604249b2d59f4890b98db6, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.500398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7bd5c-aae2-44f4-a0f5-38d3990b9cfe admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.527112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 935/1883] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:22 2022] PUT /identity/v3/projects/47b9e5d4e0c248b3b60bc1a03ee0cce4/users/9d026d82b1604249b2d59f4890b98db6/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:22.534663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a5508-69ac-4d16-a94e-2d105f179cef None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.535334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a5508-69ac-4d16-a94e-2d105f179cef None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.535715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a5508-69ac-4d16-a94e-2d105f179cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.536379 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f327f3-9134-44e9-b156-84dc6f50c4e0 service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.572982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-572a5508-69ac-4d16-a94e-2d105f179cef None None] MFA Rules not processed for user `9d026d82b1604249b2d59f4890b98db6`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:22.575685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-572a5508-69ac-4d16-a94e-2d105f179cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:22.575880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:22.607002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1437948-2ef5-435d-860c-fbd6753f1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.607848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1437948-2ef5-435d-860c-fbd6753f1f37 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.608159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1437948-2ef5-435d-860c-fbd6753f1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.608437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1437948-2ef5-435d-860c-fbd6753f1f37 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.609065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1437948-2ef5-435d-860c-fbd6753f1f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.611010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1437948-2ef5-435d-860c-fbd6753f1f37 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.657483 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 936/1884] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:22 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:22.666986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:22.699658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a5508-69ac-4d16-a94e-2d105f179cef None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.702385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 949/1885] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:22 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:22.710808 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a5508-69ac-4d16-a94e-2d105f179cef None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.726824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b884eb-220a-4360-8f19-c20822c1f23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.726824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b884eb-220a-4360-8f19-c20822c1f23b admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.726824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b884eb-220a-4360-8f19-c20822c1f23b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.726824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b884eb-220a-4360-8f19-c20822c1f23b admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.728383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b884eb-220a-4360-8f19-c20822c1f23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.728383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b884eb-220a-4360-8f19-c20822c1f23b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.732676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1437948-2ef5-435d-860c-fbd6753f1f37 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.742911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 937/1886] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:22.747467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b884eb-220a-4360-8f19-c20822c1f23b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.761961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b884eb-220a-4360-8f19-c20822c1f23b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.766986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3bc38-7a2a-41e8-b9ca-28d219988c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.767835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3bc38-7a2a-41e8-b9ca-28d219988c98 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.768123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3bc38-7a2a-41e8-b9ca-28d219988c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.768395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3bc38-7a2a-41e8-b9ca-28d219988c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.769117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3bc38-7a2a-41e8-b9ca-28d219988c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.770775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3bc38-7a2a-41e8-b9ca-28d219988c98 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.784536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 938/1887] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:22.788489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3bc38-7a2a-41e8-b9ca-28d219988c98 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:22.801159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3bc38-7a2a-41e8-b9ca-28d219988c98 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.804693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1437948-2ef5-435d-860c-fbd6753f1f37 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:22.807670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac141-c145-402d-b378-77ef84d5bfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.808700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac141-c145-402d-b378-77ef84d5bfb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.808996 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac141-c145-402d-b378-77ef84d5bfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.809275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac141-c145-402d-b378-77ef84d5bfb6 admin admin] PATH_INFO: `/v3/projects/c7e3512785d34d06ad4949de1f1dd235/users/a6f90db1483a44feaeee819701804474/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.809440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c655454-6d22-4855-8557-b49397babff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:22.810046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c655454-6d22-4855-8557-b49397babff7 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.812106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c655454-6d22-4855-8557-b49397babff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.813131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c655454-6d22-4855-8557-b49397babff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.828390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac141-c145-402d-b378-77ef84d5bfb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e3512785d34d06ad4949de1f1dd235, user_id=a6f90db1483a44feaeee819701804474, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.831406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac141-c145-402d-b378-77ef84d5bfb6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.834660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c655454-6d22-4855-8557-b49397babff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:22.837412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c655454-6d22-4855-8557-b49397babff7 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:22.848472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 950/1888] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:22 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:22.952497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 939/1889] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:22 2022] PUT /identity/v3/projects/c7e3512785d34d06ad4949de1f1dd235/users/a6f90db1483a44feaeee819701804474/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:22.965349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131179-12c2-4b84-8620-158ef4479904 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:22.965841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131179-12c2-4b84-8620-158ef4479904 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:22.966119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131179-12c2-4b84-8620-158ef4479904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:22.998609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-73131179-12c2-4b84-8620-158ef4479904 None None] MFA Rules not processed for user `a6f90db1483a44feaeee819701804474`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:22.999881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-73131179-12c2-4b84-8620-158ef4479904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:23.067381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 951/1890] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:23.072124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac141-c145-402d-b378-77ef84d5bfb6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.135451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac141-c145-402d-b378-77ef84d5bfb6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.140208 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc6ecb-9df6-4283-a133-afb1c66015aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.140819 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc6ecb-9df6-4283-a133-afb1c66015aa admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.141106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc6ecb-9df6-4283-a133-afb1c66015aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.141392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc6ecb-9df6-4283-a133-afb1c66015aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.142035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc6ecb-9df6-4283-a133-afb1c66015aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.144026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc6ecb-9df6-4283-a133-afb1c66015aa admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.237600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 940/1891] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:23 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:23.242438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73131179-12c2-4b84-8620-158ef4479904 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.243931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc6ecb-9df6-4283-a133-afb1c66015aa admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.257443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73131179-12c2-4b84-8620-158ef4479904 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.314289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:23.323448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc6ecb-9df6-4283-a133-afb1c66015aa admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.327171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13685729-21fd-4abd-957e-8cb418848e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.327850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13685729-21fd-4abd-957e-8cb418848e06 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.328136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13685729-21fd-4abd-957e-8cb418848e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.328553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13685729-21fd-4abd-957e-8cb418848e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.330340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-13685729-21fd-4abd-957e-8cb418848e06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:23.342015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e97e6-5561-44b0-b9a8-10da1d5055fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.342748 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e97e6-5561-44b0-b9a8-10da1d5055fa admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.343037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e97e6-5561-44b0-b9a8-10da1d5055fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.343462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e97e6-5561-44b0-b9a8-10da1d5055fa admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.344254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e97e6-5561-44b0-b9a8-10da1d5055fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.347009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e97e6-5561-44b0-b9a8-10da1d5055fa admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.403785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:23.414674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13685729-21fd-4abd-957e-8cb418848e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.416162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13685729-21fd-4abd-957e-8cb418848e06 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.425178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 941/1892] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:23 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:23.441672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 952/1893] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:23 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:23.446905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13685729-21fd-4abd-957e-8cb418848e06 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.459576 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13685729-21fd-4abd-957e-8cb418848e06 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.466721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a72234-d45b-48a5-9f2e-fa0a058bcca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.466721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a72234-d45b-48a5-9f2e-fa0a058bcca5 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.466721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a72234-d45b-48a5-9f2e-fa0a058bcca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.466721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a72234-d45b-48a5-9f2e-fa0a058bcca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.467071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a72234-d45b-48a5-9f2e-fa0a058bcca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.468163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a72234-d45b-48a5-9f2e-fa0a058bcca5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.478569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 942/1894] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:23.482989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e97e6-5561-44b0-b9a8-10da1d5055fa admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.493580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e97e6-5561-44b0-b9a8-10da1d5055fa admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.498442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdfada-7787-496c-9de8-8826e2306ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.499111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdfada-7787-496c-9de8-8826e2306ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.499465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdfada-7787-496c-9de8-8826e2306ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.499746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdfada-7787-496c-9de8-8826e2306ae5 admin admin] PATH_INFO: `/v3/projects/e53133522bb943758279ab139fdf663d/users/5e114957a39a46b3a0146c06ee7f3533/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.516421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdfada-7787-496c-9de8-8826e2306ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e53133522bb943758279ab139fdf663d, user_id=5e114957a39a46b3a0146c06ee7f3533, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.519193 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdfada-7787-496c-9de8-8826e2306ae5 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.598171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 953/1895] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:23 2022] PUT /identity/v3/projects/e53133522bb943758279ab139fdf663d/users/5e114957a39a46b3a0146c06ee7f3533/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:23.607432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a72234-d45b-48a5-9f2e-fa0a058bcca5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.621278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a72234-d45b-48a5-9f2e-fa0a058bcca5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.621426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdfada-7787-496c-9de8-8826e2306ae5 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.682947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ac74b-582f-4262-bc7c-ee79e3e8ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.683772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ac74b-582f-4262-bc7c-ee79e3e8ee97 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.684153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ac74b-582f-4262-bc7c-ee79e3e8ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.684435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ac74b-582f-4262-bc7c-ee79e3e8ee97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.685081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ac74b-582f-4262-bc7c-ee79e3e8ee97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.685970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdfada-7787-496c-9de8-8826e2306ae5 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.686686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ac74b-582f-4262-bc7c-ee79e3e8ee97 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.690825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ce8d1-ebc8-44ff-8b34-8895545541eb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262ef8f9670841dbbe755614175cdc17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '594f5e5e0238432eafcbe8122efa8127', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.691480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ce8d1-ebc8-44ff-8b34-8895545541eb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.691765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ce8d1-ebc8-44ff-8b34-8895545541eb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.692046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ce8d1-ebc8-44ff-8b34-8895545541eb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.692693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ce8d1-ebc8-44ff-8b34-8895545541eb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:23.693751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ce8d1-ebc8-44ff-8b34-8895545541eb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.695366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ce8d1-ebc8-44ff-8b34-8895545541eb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.698246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 943/1896] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:23.702460 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ac74b-582f-4262-bc7c-ee79e3e8ee97 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.709653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 954/1897] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:55:23.713603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ac74b-582f-4262-bc7c-ee79e3e8ee97 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.713932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ce8d1-ebc8-44ff-8b34-8895545541eb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.719441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529e759-47d1-49f4-9709-23f668d087f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.720130 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529e759-47d1-49f4-9709-23f668d087f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.720393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529e759-47d1-49f4-9709-23f668d087f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.720674 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529e759-47d1-49f4-9709-23f668d087f5 admin admin] PATH_INFO: `/v3/projects/e53133522bb943758279ab139fdf663d/users/5e114957a39a46b3a0146c06ee7f3533/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.722599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529e759-47d1-49f4-9709-23f668d087f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e53133522bb943758279ab139fdf663d, user_id=5e114957a39a46b3a0146c06ee7f3533, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.723997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ce8d1-ebc8-44ff-8b34-8895545541eb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.725540 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529e759-47d1-49f4-9709-23f668d087f5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.728920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51492c-7c63-4c84-9749-4a1741dbe3e0 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262ef8f9670841dbbe755614175cdc17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '594f5e5e0238432eafcbe8122efa8127', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.736427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51492c-7c63-4c84-9749-4a1741dbe3e0 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.736427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51492c-7c63-4c84-9749-4a1741dbe3e0 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.736427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51492c-7c63-4c84-9749-4a1741dbe3e0 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.736427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51492c-7c63-4c84-9749-4a1741dbe3e0 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.736427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51492c-7c63-4c84-9749-4a1741dbe3e0 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.737105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 944/1898] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:23 2022] PUT /identity/v3/projects/e53133522bb943758279ab139fdf663d/users/5e114957a39a46b3a0146c06ee7f3533/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:23.747319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d673cd-5d47-4f42-bb9b-715974ea7c1e None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.747612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d673cd-5d47-4f42-bb9b-715974ea7c1e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.747895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d673cd-5d47-4f42-bb9b-715974ea7c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.765469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:23.782384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c9d673cd-5d47-4f42-bb9b-715974ea7c1e None None] MFA Rules not processed for user `5e114957a39a46b3a0146c06ee7f3533`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:23.783606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c9d673cd-5d47-4f42-bb9b-715974ea7c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:23.828208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 955/1899] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:23 2022] POST /identity/v3/projects => generated 354 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:55:23.832307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51492c-7c63-4c84-9749-4a1741dbe3e0 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:23.843434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:23.876558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 945/1900] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:23.898565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51492c-7c63-4c84-9749-4a1741dbe3e0 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:23.903222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0a83e-1829-4dfa-8443-df7bd5f56cdb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262ef8f9670841dbbe755614175cdc17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '594f5e5e0238432eafcbe8122efa8127', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:23.903862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0a83e-1829-4dfa-8443-df7bd5f56cdb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:23.904150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0a83e-1829-4dfa-8443-df7bd5f56cdb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:23.904510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0a83e-1829-4dfa-8443-df7bd5f56cdb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:23.905579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0a83e-1829-4dfa-8443-df7bd5f56cdb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:23.906088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0a83e-1829-4dfa-8443-df7bd5f56cdb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:23.908203 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0a83e-1829-4dfa-8443-df7bd5f56cdb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:23.920509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 956/1901] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:24.066307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d673cd-5d47-4f42-bb9b-715974ea7c1e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:24.067802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c9d673cd-5d47-4f42-bb9b-715974ea7c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:24.129757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.138945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0a83e-1829-4dfa-8443-df7bd5f56cdb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:24.141953 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d673cd-5d47-4f42-bb9b-715974ea7c1e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:24.156047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0a83e-1829-4dfa-8443-df7bd5f56cdb tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:24.178897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262ef8f9670841dbbe755614175cdc17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '594f5e5e0238432eafcbe8122efa8127', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:24.179313 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:24.179623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:24.179904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] PATH_INFO: `/v3/projects/4736ecf24cdc45e7a35cbf72f7bd5ff3` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:24.188528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4736ecf24cdc45e7a35cbf72f7bd5ff3)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:24.190509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:24.206125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052dc7-40f9-4bb1-9b38-d9e8bf568a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:24.207033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052dc7-40f9-4bb1-9b38-d9e8bf568a01 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:24.207525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052dc7-40f9-4bb1-9b38-d9e8bf568a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:24.207834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052dc7-40f9-4bb1-9b38-d9e8bf568a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:24.280315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26052dc7-40f9-4bb1-9b38-d9e8bf568a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:24.281798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26052dc7-40f9-4bb1-9b38-d9e8bf568a01 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:24.294889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 946/1902] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:24.319001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4736ecf24cdc45e7a35cbf72f7bd5ff3', 'request_id': 'req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:24.336652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4736ecf24cdc45e7a35cbf72f7bd5ff3', 'request_id': 'req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:24.399077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4736ecf24cdc45e7a35cbf72f7bd5ff3', 'request_id': 'req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:24.412740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] The token cache is being invalidate because project 4736ecf24cdc45e7a35cbf72f7bd5ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:24.413032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:24.413914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:24.415442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 957/1903] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:24 2022] DELETE /identity/v3/projects/4736ecf24cdc45e7a35cbf72f7bd5ff3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:24.576479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.713849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052dc7-40f9-4bb1-9b38-d9e8bf568a01 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:24.722226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052dc7-40f9-4bb1-9b38-d9e8bf568a01 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:24.729282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:24.770511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb08a6b-4eae-41cf-9618-b62f2c8e7634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:24.771591 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb08a6b-4eae-41cf-9618-b62f2c8e7634 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:24.771875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb08a6b-4eae-41cf-9618-b62f2c8e7634 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:24.772200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb08a6b-4eae-41cf-9618-b62f2c8e7634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:24.774273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5fb08a6b-4eae-41cf-9618-b62f2c8e7634 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:24.832278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb08a6b-4eae-41cf-9618-b62f2c8e7634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:24.833751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb08a6b-4eae-41cf-9618-b62f2c8e7634 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:24.842486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 947/1904] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:25.215023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:25.277293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:25.582930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:25.585040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:25.673757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cda2c9-5bfa-4f3a-8cd6-966e4d7cd614 tempest-VolumeQuotaClassesTest-1283816731 tempest-VolumeQuotaClassesTest-1283816731-project-admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:25.678889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:25.679929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:25.680375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:25.680810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] PATH_INFO: `/v3/users/559cfd46c40248ae9ae0401026819e73` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:25.682114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559cfd46c40248ae9ae0401026819e73)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:25.684557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:25.723308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:25.960285 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559cfd46c40248ae9ae0401026819e73'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:25.960948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559cfd46c40248ae9ae0401026819e73'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:25.961598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559cfd46c40248ae9ae0401026819e73'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:26.073434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559cfd46c40248ae9ae0401026819e73'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:26.094251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559cfd46c40248ae9ae0401026819e73'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:26.111015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 958/1905] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:25 2022] DELETE /identity/v3/users/559cfd46c40248ae9ae0401026819e73 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:26.116073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816a712-c5e2-4b04-850d-f4f5601aa910 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:26.116515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816a712-c5e2-4b04-850d-f4f5601aa910 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:26.116789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816a712-c5e2-4b04-850d-f4f5601aa910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:26.137068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-4816a712-c5e2-4b04-850d-f4f5601aa910 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:26.138368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4816a712-c5e2-4b04-850d-f4f5601aa910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:26.201161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 948/1906] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:26.212223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:26.213695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:26.279048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedf923-0bbe-4b38-a45d-f5da812d4e78 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:26.282599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7d7e-78a2-49c5-afea-c7840e341dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:26.283200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7d7e-78a2-49c5-afea-c7840e341dcf service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:26.283509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7d7e-78a2-49c5-afea-c7840e341dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:26.283792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7d7e-78a2-49c5-afea-c7840e341dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:26.293346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb7d7e-78a2-49c5-afea-c7840e341dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:26.294829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb7d7e-78a2-49c5-afea-c7840e341dcf service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:26.305577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 959/1907] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:26.323872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:26.563331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:26.871894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816a712-c5e2-4b04-850d-f4f5601aa910 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:26.873715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4816a712-c5e2-4b04-850d-f4f5601aa910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:26.893219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816a712-c5e2-4b04-850d-f4f5601aa910 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:26.904847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:26.905885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:26.907642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:26.908052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] PATH_INFO: `/v3/projects/47d5c93718bb41048a9d2156d9d38c27` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:26.912038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d5c93718bb41048a9d2156d9d38c27)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:26.922979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:27.039427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:27.067545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d5c93718bb41048a9d2156d9d38c27', 'request_id': 'req-6142722f-3c62-42b0-8990-0911136c7877'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.135580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d5c93718bb41048a9d2156d9d38c27', 'request_id': 'req-6142722f-3c62-42b0-8990-0911136c7877'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.143783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d5c93718bb41048a9d2156d9d38c27', 'request_id': 'req-6142722f-3c62-42b0-8990-0911136c7877'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.155022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] The token cache is being invalidate because project 47d5c93718bb41048a9d2156d9d38c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:27.155343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.156014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6142722f-3c62-42b0-8990-0911136c7877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.157598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 949/1908] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:26 2022] DELETE /identity/v3/projects/47d5c93718bb41048a9d2156d9d38c27 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:27.161873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7d7e-78a2-49c5-afea-c7840e341dcf service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:27.171892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7d7e-78a2-49c5-afea-c7840e341dcf service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:27.180799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:27.245552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:27.246400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:27.246875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:27.247265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] PATH_INFO: `/v3/users/262ef8f9670841dbbe755614175cdc17` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:27.251479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=262ef8f9670841dbbe755614175cdc17)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:27.251603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:27.251693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:27.410928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262ef8f9670841dbbe755614175cdc17'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.411626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262ef8f9670841dbbe755614175cdc17'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.412782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262ef8f9670841dbbe755614175cdc17'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.482826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262ef8f9670841dbbe755614175cdc17'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.499226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262ef8f9670841dbbe755614175cdc17'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:27.513641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 960/1909] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:27 2022] DELETE /identity/v3/users/262ef8f9670841dbbe755614175cdc17 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:28.127923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:28.128205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f334d4-9bda-4c19-970f-98974ca06e8d None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:28.129132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f334d4-9bda-4c19-970f-98974ca06e8d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:28.129585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f334d4-9bda-4c19-970f-98974ca06e8d None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:28.131964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:28.133567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 950/1910] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:55:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:28.151722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38e351-b0aa-4fe7-92ed-31ff0fbfad14 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:28.152356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38e351-b0aa-4fe7-92ed-31ff0fbfad14 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:28.157041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38e351-b0aa-4fe7-92ed-31ff0fbfad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:28.218613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2a38e351-b0aa-4fe7-92ed-31ff0fbfad14 None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:28.220208 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2a38e351-b0aa-4fe7-92ed-31ff0fbfad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:28.244606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:28.344513 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 951/1911] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:55:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:28.349048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537ca31-4513-4503-a62c-c3233fd138eb admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:28.365749 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:28.367051 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:28.367656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:28.368133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] PATH_INFO: `/v3/projects/594f5e5e0238432eafcbe8122efa8127` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:28.372534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594f5e5e0238432eafcbe8122efa8127)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:28.377973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:28.447391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38e351-b0aa-4fe7-92ed-31ff0fbfad14 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:28.448901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2a38e351-b0aa-4fe7-92ed-31ff0fbfad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:28.466554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38e351-b0aa-4fe7-92ed-31ff0fbfad14 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:28.472442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f50e59-fc2b-4dcd-8c6c-1fa4c2611e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:28.473060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f50e59-fc2b-4dcd-8c6c-1fa4c2611e8b service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:28.473346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f50e59-fc2b-4dcd-8c6c-1fa4c2611e8b service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:28.473624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f50e59-fc2b-4dcd-8c6c-1fa4c2611e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:28.483575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f50e59-fc2b-4dcd-8c6c-1fa4c2611e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:28.485760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f50e59-fc2b-4dcd-8c6c-1fa4c2611e8b service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:28.499679 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 952/1912] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:28.505494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:28.531606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594f5e5e0238432eafcbe8122efa8127', 'request_id': 'req-3aa7b8f2-ef24-46ab-887c-1831ebc54117'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:28.540222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594f5e5e0238432eafcbe8122efa8127', 'request_id': 'req-3aa7b8f2-ef24-46ab-887c-1831ebc54117'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:28.649911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594f5e5e0238432eafcbe8122efa8127', 'request_id': 'req-3aa7b8f2-ef24-46ab-887c-1831ebc54117'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:28.661538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] The token cache is being invalidate because project 594f5e5e0238432eafcbe8122efa8127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:28.661744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:28.663085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3aa7b8f2-ef24-46ab-887c-1831ebc54117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:28.664980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 961/1913] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:28 2022] DELETE /identity/v3/projects/594f5e5e0238432eafcbe8122efa8127 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:28.671376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964064-d494-4634-8271-f99cc7ee4590 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:28.671839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964064-d494-4634-8271-f99cc7ee4590 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:28.672319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964064-d494-4634-8271-f99cc7ee4590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:28.707644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8c964064-d494-4634-8271-f99cc7ee4590 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:28.709037 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8c964064-d494-4634-8271-f99cc7ee4590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:28.772778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 953/1914] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:28.780672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57ec5c-264f-426c-b00b-b274013b26aa None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:28.780961 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57ec5c-264f-426c-b00b-b274013b26aa None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:28.781244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57ec5c-264f-426c-b00b-b274013b26aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:28.801514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8c57ec5c-264f-426c-b00b-b274013b26aa None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:28.807677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8c57ec5c-264f-426c-b00b-b274013b26aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:28.811430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 962/1915] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:28.816005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c964064-d494-4634-8271-f99cc7ee4590 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:28.826951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c964064-d494-4634-8271-f99cc7ee4590 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:28.831563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3839-65b2-4561-be25-f22ccddb7218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:28.832218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3839-65b2-4561-be25-f22ccddb7218 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:28.832501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3839-65b2-4561-be25-f22ccddb7218 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:28.832775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3839-65b2-4561-be25-f22ccddb7218 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:28.833425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3839-65b2-4561-be25-f22ccddb7218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:28.833735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3839-65b2-4561-be25-f22ccddb7218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:28.835718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3839-65b2-4561-be25-f22ccddb7218 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:28.847372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 954/1916] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:28.852388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57ec5c-264f-426c-b00b-b274013b26aa None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:28.862869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57ec5c-264f-426c-b00b-b274013b26aa None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:28.869825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2993a1-40b2-4807-8df7-e81953281fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:28.870500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2993a1-40b2-4807-8df7-e81953281fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:28.870778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2993a1-40b2-4807-8df7-e81953281fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:28.872583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2993a1-40b2-4807-8df7-e81953281fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:28.873324 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2993a1-40b2-4807-8df7-e81953281fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:28.875114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2993a1-40b2-4807-8df7-e81953281fa0 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:29.023273 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 963/1917] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:28 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:29.027468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3839-65b2-4561-be25-f22ccddb7218 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:29.038348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3839-65b2-4561-be25-f22ccddb7218 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:29.103076 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592067ac-c60d-4869-9421-1b0be861eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:29.103776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592067ac-c60d-4869-9421-1b0be861eb99 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:29.104086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592067ac-c60d-4869-9421-1b0be861eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:29.104487 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592067ac-c60d-4869-9421-1b0be861eb99 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:29.105089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592067ac-c60d-4869-9421-1b0be861eb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:29.107141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592067ac-c60d-4869-9421-1b0be861eb99 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:29.201529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 955/1918] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:29 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:29.205763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2993a1-40b2-4807-8df7-e81953281fa0 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:29.217971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2993a1-40b2-4807-8df7-e81953281fa0 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:29.223056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299ebd1-50cd-4bc3-b493-3341f25623bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:29.223704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299ebd1-50cd-4bc3-b493-3341f25623bd admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:29.224016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299ebd1-50cd-4bc3-b493-3341f25623bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:29.224455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299ebd1-50cd-4bc3-b493-3341f25623bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:29.225132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299ebd1-50cd-4bc3-b493-3341f25623bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:29.226888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299ebd1-50cd-4bc3-b493-3341f25623bd admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:29.237521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 964/1919] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:29.243606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592067ac-c60d-4869-9421-1b0be861eb99 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:29.255549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592067ac-c60d-4869-9421-1b0be861eb99 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:29.261516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212323e9-1a18-44d2-aec1-ad2547edebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:29.262281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212323e9-1a18-44d2-aec1-ad2547edebc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:29.262570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212323e9-1a18-44d2-aec1-ad2547edebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:29.265827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212323e9-1a18-44d2-aec1-ad2547edebc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:29.265827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212323e9-1a18-44d2-aec1-ad2547edebc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:29.265827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212323e9-1a18-44d2-aec1-ad2547edebc5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:29.276430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 956/1920] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:29.280799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299ebd1-50cd-4bc3-b493-3341f25623bd admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:29.294569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299ebd1-50cd-4bc3-b493-3341f25623bd admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:29.299960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a4a0a-2e8c-4ce4-a261-cf63eb5d0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:29.300986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a4a0a-2e8c-4ce4-a261-cf63eb5d0d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:29.301325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a4a0a-2e8c-4ce4-a261-cf63eb5d0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:29.301801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a4a0a-2e8c-4ce4-a261-cf63eb5d0d86 admin admin] PATH_INFO: `/v3/projects/b270937ffc3946e7a57d91351eeb6f0b/users/b121b1e092be449dad539976d53bb70e/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:29.321330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a4a0a-2e8c-4ce4-a261-cf63eb5d0d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b270937ffc3946e7a57d91351eeb6f0b, user_id=b121b1e092be449dad539976d53bb70e, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:29.324113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a4a0a-2e8c-4ce4-a261-cf63eb5d0d86 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:29.392355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 965/1921] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:29 2022] PUT /identity/v3/projects/b270937ffc3946e7a57d91351eeb6f0b/users/b121b1e092be449dad539976d53bb70e/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:29.402745 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf702d-5a6b-4052-87fa-c778420b46a5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:29.403017 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf702d-5a6b-4052-87fa-c778420b46a5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:29.403311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf702d-5a6b-4052-87fa-c778420b46a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:29.431375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2baf702d-5a6b-4052-87fa-c778420b46a5 None None] MFA Rules not processed for user `b121b1e092be449dad539976d53bb70e`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:29.432641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2baf702d-5a6b-4052-87fa-c778420b46a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:29.502604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 957/1922] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:29.508071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a4a0a-2e8c-4ce4-a261-cf63eb5d0d86 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:29.564490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:29.581029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a4a0a-2e8c-4ce4-a261-cf63eb5d0d86 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:29.586870 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960bf0-8782-4ed8-a86f-55555441f085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:29.587535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960bf0-8782-4ed8-a86f-55555441f085 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:29.587819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960bf0-8782-4ed8-a86f-55555441f085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:29.588087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960bf0-8782-4ed8-a86f-55555441f085 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:29.588705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06960bf0-8782-4ed8-a86f-55555441f085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:29.600664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06960bf0-8782-4ed8-a86f-55555441f085 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:29.762565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 966/1923] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:29 2022] POST /identity/v3/projects => generated 389 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:29.766950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf702d-5a6b-4052-87fa-c778420b46a5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:29.778944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf702d-5a6b-4052-87fa-c778420b46a5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:29.830512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960bf0-8782-4ed8-a86f-55555441f085 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:29.832276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-06960bf0-8782-4ed8-a86f-55555441f085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:29.855325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09bbba-20b3-4cad-9d6c-7811a1712a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:29.856056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09bbba-20b3-4cad-9d6c-7811a1712a8f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:29.856406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09bbba-20b3-4cad-9d6c-7811a1712a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:29.856748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09bbba-20b3-4cad-9d6c-7811a1712a8f admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:29.857466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09bbba-20b3-4cad-9d6c-7811a1712a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:29.859868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09bbba-20b3-4cad-9d6c-7811a1712a8f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:29.925474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960bf0-8782-4ed8-a86f-55555441f085 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:29.931326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:29.932451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:29.932873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:29.933299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] PATH_INFO: `/v3/users/04e14b1f2da242299dc8b3736ac6872b` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:29.934592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e14b1f2da242299dc8b3736ac6872b)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:29.936802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:29.988019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 958/1924] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:29 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:55:29.997597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09bbba-20b3-4cad-9d6c-7811a1712a8f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:30.009568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09bbba-20b3-4cad-9d6c-7811a1712a8f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:30.014487 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f757e-58af-4e97-9afb-9cdfb00a8820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:30.015216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f757e-58af-4e97-9afb-9cdfb00a8820 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.015636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f757e-58af-4e97-9afb-9cdfb00a8820 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.015960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f757e-58af-4e97-9afb-9cdfb00a8820 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.016653 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f757e-58af-4e97-9afb-9cdfb00a8820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:30.018571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f757e-58af-4e97-9afb-9cdfb00a8820 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:30.037154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 959/1925] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:30.048897 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f757e-58af-4e97-9afb-9cdfb00a8820 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:30.076461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f757e-58af-4e97-9afb-9cdfb00a8820 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:30.084376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821c361-b6e7-4343-a06a-aee39f33c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:30.085263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821c361-b6e7-4343-a06a-aee39f33c8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.090204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821c361-b6e7-4343-a06a-aee39f33c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.090204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821c361-b6e7-4343-a06a-aee39f33c8b9 admin admin] PATH_INFO: `/v3/projects/0ddb8757b6144484a247dcd68bf1f715/users/a98cba297d19454484884f18ea56bf7f/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.116688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821c361-b6e7-4343-a06a-aee39f33c8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddb8757b6144484a247dcd68bf1f715, user_id=a98cba297d19454484884f18ea56bf7f, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:30.131520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821c361-b6e7-4343-a06a-aee39f33c8b9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:30.203835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 960/1926] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:30 2022] PUT /identity/v3/projects/0ddb8757b6144484a247dcd68bf1f715/users/a98cba297d19454484884f18ea56bf7f/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:30.208011 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821c361-b6e7-4343-a06a-aee39f33c8b9 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:30.216062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e14b1f2da242299dc8b3736ac6872b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:30.218022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e14b1f2da242299dc8b3736ac6872b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:30.220321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e14b1f2da242299dc8b3736ac6872b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:30.284002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821c361-b6e7-4343-a06a-aee39f33c8b9 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:30.290325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610dee5-3fec-4296-9d0e-d92e73ec4e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:30.291022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610dee5-3fec-4296-9d0e-d92e73ec4e25 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.291456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610dee5-3fec-4296-9d0e-d92e73ec4e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.291813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610dee5-3fec-4296-9d0e-d92e73ec4e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.292528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610dee5-3fec-4296-9d0e-d92e73ec4e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:30.294573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610dee5-3fec-4296-9d0e-d92e73ec4e25 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:30.310366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 961/1927] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:30.318141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610dee5-3fec-4296-9d0e-d92e73ec4e25 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:30.320199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3610dee5-3fec-4296-9d0e-d92e73ec4e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:30.335125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610dee5-3fec-4296-9d0e-d92e73ec4e25 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:30.336153 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e14b1f2da242299dc8b3736ac6872b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:30.341060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153331e-ac0a-4779-b94f-94617130afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:30.341880 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153331e-ac0a-4779-b94f-94617130afcc admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.342226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153331e-ac0a-4779-b94f-94617130afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.342565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153331e-ac0a-4779-b94f-94617130afcc admin admin] PATH_INFO: `/v3/projects/0ddb8757b6144484a247dcd68bf1f715/users/a98cba297d19454484884f18ea56bf7f/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.344825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153331e-ac0a-4779-b94f-94617130afcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddb8757b6144484a247dcd68bf1f715, user_id=a98cba297d19454484884f18ea56bf7f, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:30.347770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153331e-ac0a-4779-b94f-94617130afcc admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:30.363781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3846c45a-3b2e-49c2-becf-083463eef9b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e14b1f2da242299dc8b3736ac6872b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:30.364373 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 962/1928] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:30 2022] PUT /identity/v3/projects/0ddb8757b6144484a247dcd68bf1f715/users/a98cba297d19454484884f18ea56bf7f/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:30.376869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d2302-a069-41ec-ae6d-cfbbdc5f8518 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.377310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d2302-a069-41ec-ae6d-cfbbdc5f8518 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.377691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d2302-a069-41ec-ae6d-cfbbdc5f8518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.378586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 967/1929] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:29 2022] DELETE /identity/v3/users/04e14b1f2da242299dc8b3736ac6872b => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:30.384086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659ea0-f2fe-4fce-acea-6fa4843ef9c8 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.385461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659ea0-f2fe-4fce-acea-6fa4843ef9c8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.385777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659ea0-f2fe-4fce-acea-6fa4843ef9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.406366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-0a659ea0-f2fe-4fce-acea-6fa4843ef9c8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:30.407668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0a659ea0-f2fe-4fce-acea-6fa4843ef9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:30.423739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-bb9d2302-a069-41ec-ae6d-cfbbdc5f8518 None None] MFA Rules not processed for user `a98cba297d19454484884f18ea56bf7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:30.425031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bb9d2302-a069-41ec-ae6d-cfbbdc5f8518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:30.494683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 968/1930] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:30.504564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a659ea0-f2fe-4fce-acea-6fa4843ef9c8 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:30.505979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0a659ea0-f2fe-4fce-acea-6fa4843ef9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:30.508328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 963/1931] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:30 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:30.519024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d2302-a069-41ec-ae6d-cfbbdc5f8518 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:30.520393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bb9d2302-a069-41ec-ae6d-cfbbdc5f8518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:30.565393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a659ea0-f2fe-4fce-acea-6fa4843ef9c8 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:30.569629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caa2cb-2ac0-44b4-9faa-eaa5630dbac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:30.570248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caa2cb-2ac0-44b4-9faa-eaa5630dbac9 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.570633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caa2cb-2ac0-44b4-9faa-eaa5630dbac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.570835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caa2cb-2ac0-44b4-9faa-eaa5630dbac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.578958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d2302-a069-41ec-ae6d-cfbbdc5f8518 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:30.580441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90caa2cb-2ac0-44b4-9faa-eaa5630dbac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:30.581889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90caa2cb-2ac0-44b4-9faa-eaa5630dbac9 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:30.582622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185126f4-69e0-48d9-b62f-36c29fc8cdcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:30.583229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185126f4-69e0-48d9-b62f-36c29fc8cdcc service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.583541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185126f4-69e0-48d9-b62f-36c29fc8cdcc service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.583854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185126f4-69e0-48d9-b62f-36c29fc8cdcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.591233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 969/1932] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:30.593348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185126f4-69e0-48d9-b62f-36c29fc8cdcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:30.594825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185126f4-69e0-48d9-b62f-36c29fc8cdcc service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:30.596841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:30.616388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 964/1933] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:30.680880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caa2cb-2ac0-44b4-9faa-eaa5630dbac9 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:30.682358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-90caa2cb-2ac0-44b4-9faa-eaa5630dbac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:30.699731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caa2cb-2ac0-44b4-9faa-eaa5630dbac9 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:30.714030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8df2c-d3a1-4b20-8862-2c404d18b6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:30.714030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8df2c-d3a1-4b20-8862-2c404d18b6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.714030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8df2c-d3a1-4b20-8862-2c404d18b6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.714030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8df2c-d3a1-4b20-8862-2c404d18b6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.714436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-21c8df2c-d3a1-4b20-8862-2c404d18b6c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:30.806964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8df2c-d3a1-4b20-8862-2c404d18b6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:30.808565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8df2c-d3a1-4b20-8862-2c404d18b6c1 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:30.820441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 970/1934] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:30.920451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:31.113470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185126f4-69e0-48d9-b62f-36c29fc8cdcc service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:31.114891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-185126f4-69e0-48d9-b62f-36c29fc8cdcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:31.130160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185126f4-69e0-48d9-b62f-36c29fc8cdcc service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:31.134941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:31.136695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.137088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.137244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] PATH_INFO: `/v3/projects/01451fcbb0cd4624b8c83a85ee7b4e0c` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.138614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01451fcbb0cd4624b8c83a85ee7b4e0c)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:31.140659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:31.246155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01451fcbb0cd4624b8c83a85ee7b4e0c', 'request_id': 'req-29a0b077-b350-4ac1-b350-7174a1bf2f20'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:31.323565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01451fcbb0cd4624b8c83a85ee7b4e0c', 'request_id': 'req-29a0b077-b350-4ac1-b350-7174a1bf2f20'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:31.330687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01451fcbb0cd4624b8c83a85ee7b4e0c', 'request_id': 'req-29a0b077-b350-4ac1-b350-7174a1bf2f20'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:31.346556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] The token cache is being invalidate because project 01451fcbb0cd4624b8c83a85ee7b4e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:31.346844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:31.347537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-29a0b077-b350-4ac1-b350-7174a1bf2f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:31.349050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 965/1935] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:31 2022] DELETE /identity/v3/projects/01451fcbb0cd4624b8c83a85ee7b4e0c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:31.354474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed388a-fe9d-4ba9-9ab0-7c5a95a838c2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.355112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed388a-fe9d-4ba9-9ab0-7c5a95a838c2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.355604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed388a-fe9d-4ba9-9ab0-7c5a95a838c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.379114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-11ed388a-fe9d-4ba9-9ab0-7c5a95a838c2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:31.380396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-11ed388a-fe9d-4ba9-9ab0-7c5a95a838c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:31.448456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 971/1936] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:31.456356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd49c-fc57-4c3a-a1b9-d3788a7f5df5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.456717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd49c-fc57-4c3a-a1b9-d3788a7f5df5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.457085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd49c-fc57-4c3a-a1b9-d3788a7f5df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.478357 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-777cd49c-fc57-4c3a-a1b9-d3788a7f5df5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:31.478784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-777cd49c-fc57-4c3a-a1b9-d3788a7f5df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:31.486886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 966/1937] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:31.492536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed388a-fe9d-4ba9-9ab0-7c5a95a838c2 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:31.502500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed388a-fe9d-4ba9-9ab0-7c5a95a838c2 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:31.507155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:31.507792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.508095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.508348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.508982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:31.509278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:31.510877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:31.525130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 972/1938] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:55:31.532465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd49c-fc57-4c3a-a1b9-d3788a7f5df5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:31.542970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cd49c-fc57-4c3a-a1b9-d3788a7f5df5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:31.547901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29742c8d-f8ff-4e85-8b1d-d90c260dbc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:31.548511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29742c8d-f8ff-4e85-8b1d-d90c260dbc13 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.548813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29742c8d-f8ff-4e85-8b1d-d90c260dbc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.549091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29742c8d-f8ff-4e85-8b1d-d90c260dbc13 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.556559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29742c8d-f8ff-4e85-8b1d-d90c260dbc13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:31.556559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29742c8d-f8ff-4e85-8b1d-d90c260dbc13 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:31.635503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:31.637253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:31.644480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:31.652366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d5926-299a-48a6-bef8-13aabe64f588 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:31.657008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:31.657635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.657976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.658187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] PATH_INFO: `/v3/users/6db7a7a656d2490bbbdc2d40cd10a926` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.659908 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db7a7a656d2490bbbdc2d40cd10a926)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:31.661909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:31.679668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 967/1939] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:31 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:31.684569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29742c8d-f8ff-4e85-8b1d-d90c260dbc13 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:31.797270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:31.800002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29742c8d-f8ff-4e85-8b1d-d90c260dbc13 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:31.815467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fc0b5-f078-4538-b9fb-a3d3a7eeac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:31.816112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fc0b5-f078-4538-b9fb-a3d3a7eeac4d admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.816401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fc0b5-f078-4538-b9fb-a3d3a7eeac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.816643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fc0b5-f078-4538-b9fb-a3d3a7eeac4d admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.817279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fc0b5-f078-4538-b9fb-a3d3a7eeac4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:31.819645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fc0b5-f078-4538-b9fb-a3d3a7eeac4d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:31.932462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db7a7a656d2490bbbdc2d40cd10a926'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:31.933982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db7a7a656d2490bbbdc2d40cd10a926'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:31.934963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db7a7a656d2490bbbdc2d40cd10a926'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:31.954696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 968/1940] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:31 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:31.958133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fc0b5-f078-4538-b9fb-a3d3a7eeac4d admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:31.961827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-238fc0b5-f078-4538-b9fb-a3d3a7eeac4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:32.002302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fc0b5-f078-4538-b9fb-a3d3a7eeac4d admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:32.016458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d47ae7-478a-46dd-8aa2-87d60a274433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:32.017461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d47ae7-478a-46dd-8aa2-87d60a274433 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:32.019756 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d47ae7-478a-46dd-8aa2-87d60a274433 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:32.020293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d47ae7-478a-46dd-8aa2-87d60a274433 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:32.024244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d47ae7-478a-46dd-8aa2-87d60a274433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:32.033049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d47ae7-478a-46dd-8aa2-87d60a274433 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:32.057399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db7a7a656d2490bbbdc2d40cd10a926'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:32.084404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 969/1941] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:32.085374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d47ae7-478a-46dd-8aa2-87d60a274433 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:32.090268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-dc3ecaba-1269-4a8d-8285-b8bc5dc22a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db7a7a656d2490bbbdc2d40cd10a926'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:32.108336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d47ae7-478a-46dd-8aa2-87d60a274433 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:32.123326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01158-a4ea-4daf-a9be-11e41e14d09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:32.124361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01158-a4ea-4daf-a9be-11e41e14d09f admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:32.124879 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01158-a4ea-4daf-a9be-11e41e14d09f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:32.125360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01158-a4ea-4daf-a9be-11e41e14d09f admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:32.126266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b01158-a4ea-4daf-a9be-11e41e14d09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:32.127571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 973/1942] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:31 2022] DELETE /identity/v3/users/6db7a7a656d2490bbbdc2d40cd10a926 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:32.133369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b01158-a4ea-4daf-a9be-11e41e14d09f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:32.136005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52012f9d-6520-4a7d-b6ca-1ad6f0b4ae92 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:32.136487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52012f9d-6520-4a7d-b6ca-1ad6f0b4ae92 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:32.136771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52012f9d-6520-4a7d-b6ca-1ad6f0b4ae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:32.158456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 970/1943] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:32.175868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01158-a4ea-4daf-a9be-11e41e14d09f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:32.199988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01158-a4ea-4daf-a9be-11e41e14d09f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:32.211330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-52012f9d-6520-4a7d-b6ca-1ad6f0b4ae92 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:32.214095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-52012f9d-6520-4a7d-b6ca-1ad6f0b4ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:32.330478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb27b-99ec-47be-bd90-5c618e0729ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:32.331228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb27b-99ec-47be-bd90-5c618e0729ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:32.331552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb27b-99ec-47be-bd90-5c618e0729ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:32.331831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bb27b-99ec-47be-bd90-5c618e0729ac admin admin] PATH_INFO: `/v3/projects/c5607c612e95421aaca050afba32fb78/users/8771fc570c2241e8b311436e93c066de/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:32.340725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 974/1944] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:32.359641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52012f9d-6520-4a7d-b6ca-1ad6f0b4ae92 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:32.359641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-52012f9d-6520-4a7d-b6ca-1ad6f0b4ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:32.366677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb27b-99ec-47be-bd90-5c618e0729ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5607c612e95421aaca050afba32fb78, user_id=8771fc570c2241e8b311436e93c066de, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:32.370975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bb27b-99ec-47be-bd90-5c618e0729ac admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:32.431471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52012f9d-6520-4a7d-b6ca-1ad6f0b4ae92 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:32.435226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666e165-d747-4c97-bffd-e26391f6a415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:32.435701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666e165-d747-4c97-bffd-e26391f6a415 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:32.435983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666e165-d747-4c97-bffd-e26391f6a415 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:32.436256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666e165-d747-4c97-bffd-e26391f6a415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:32.451637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666e165-d747-4c97-bffd-e26391f6a415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:32.451637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666e165-d747-4c97-bffd-e26391f6a415 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:32.459168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 975/1945] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:32.483340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 971/1946] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:32 2022] PUT /identity/v3/projects/c5607c612e95421aaca050afba32fb78/users/8771fc570c2241e8b311436e93c066de/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:32.493364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425554b-3844-4929-88f7-39b6b75000d5 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:32.493680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425554b-3844-4929-88f7-39b6b75000d5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:32.495579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425554b-3844-4929-88f7-39b6b75000d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:32.543626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-5425554b-3844-4929-88f7-39b6b75000d5 None None] MFA Rules not processed for user `8771fc570c2241e8b311436e93c066de`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:32.544898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5425554b-3844-4929-88f7-39b6b75000d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:32.665450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 976/1947] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:32.677290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb27b-99ec-47be-bd90-5c618e0729ac admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:32.774233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bb27b-99ec-47be-bd90-5c618e0729ac admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:32.783673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0ad85-62c3-42cd-a3c2-4af7e3edef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:32.784490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0ad85-62c3-42cd-a3c2-4af7e3edef7f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:32.784988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0ad85-62c3-42cd-a3c2-4af7e3edef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:32.785336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0ad85-62c3-42cd-a3c2-4af7e3edef7f admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:32.786110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0ad85-62c3-42cd-a3c2-4af7e3edef7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:32.788546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0ad85-62c3-42cd-a3c2-4af7e3edef7f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:32.897925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 972/1948] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:32 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:32.899068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425554b-3844-4929-88f7-39b6b75000d5 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:32.924733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425554b-3844-4929-88f7-39b6b75000d5 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:32.956440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0ad85-62c3-42cd-a3c2-4af7e3edef7f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:32.958251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-07c0ad85-62c3-42cd-a3c2-4af7e3edef7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:32.989389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83737742-64e8-4ca9-91ea-104fcdc29a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:32.990610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83737742-64e8-4ca9-91ea-104fcdc29a72 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:32.991683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83737742-64e8-4ca9-91ea-104fcdc29a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:32.991978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83737742-64e8-4ca9-91ea-104fcdc29a72 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:32.992690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83737742-64e8-4ca9-91ea-104fcdc29a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:32.994864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83737742-64e8-4ca9-91ea-104fcdc29a72 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:33.040421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0ad85-62c3-42cd-a3c2-4af7e3edef7f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:33.045534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:33.046168 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.046450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.046726 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] PATH_INFO: `/v3/projects/ca1570df05774aef937031ae13aab295` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.047901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1570df05774aef937031ae13aab295)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:33.049817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:33.084222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 977/1949] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:32 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:33.088300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83737742-64e8-4ca9-91ea-104fcdc29a72 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:33.098070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83737742-64e8-4ca9-91ea-104fcdc29a72 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:33.102949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efec28-1344-4e2b-982d-45552e1f9a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:33.103575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efec28-1344-4e2b-982d-45552e1f9a9a admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.103859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efec28-1344-4e2b-982d-45552e1f9a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.104137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efec28-1344-4e2b-982d-45552e1f9a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.104770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efec28-1344-4e2b-982d-45552e1f9a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:33.106352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efec28-1344-4e2b-982d-45552e1f9a9a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:33.116975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 978/1950] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:33.120897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efec28-1344-4e2b-982d-45552e1f9a9a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:33.130187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efec28-1344-4e2b-982d-45552e1f9a9a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:33.136204 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c6b2c-9190-4bb9-9757-5f2fdebcd2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:33.136837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c6b2c-9190-4bb9-9757-5f2fdebcd2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.137122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c6b2c-9190-4bb9-9757-5f2fdebcd2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.137458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c6b2c-9190-4bb9-9757-5f2fdebcd2c5 admin admin] PATH_INFO: `/v3/projects/b003ebc90f64489f8229fab4969e1424/users/4f522300267f4690ac34e8d588b144ea/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.153553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c6b2c-9190-4bb9-9757-5f2fdebcd2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b003ebc90f64489f8229fab4969e1424, user_id=4f522300267f4690ac34e8d588b144ea, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:33.156360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c6b2c-9190-4bb9-9757-5f2fdebcd2c5 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:33.167317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1570df05774aef937031ae13aab295', 'request_id': 'req-05edbf47-f6cf-49e2-89ab-e01d853789b8'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.214547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1570df05774aef937031ae13aab295', 'request_id': 'req-05edbf47-f6cf-49e2-89ab-e01d853789b8'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.221112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 979/1951] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:33 2022] PUT /identity/v3/projects/b003ebc90f64489f8229fab4969e1424/users/4f522300267f4690ac34e8d588b144ea/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:33.223092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1570df05774aef937031ae13aab295', 'request_id': 'req-05edbf47-f6cf-49e2-89ab-e01d853789b8'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.226030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c6b2c-9190-4bb9-9757-5f2fdebcd2c5 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:33.237578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] The token cache is being invalidate because project ca1570df05774aef937031ae13aab295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:33.238409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.239199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.246152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 973/1952] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:32 2022] DELETE /identity/v3/projects/ca1570df05774aef937031ae13aab295 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:33.247513 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:33.248925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:33.314860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c6b2c-9190-4bb9-9757-5f2fdebcd2c5 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:33.315319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad57106-54de-456c-ace3-854153ff6575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:33.315960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57106-54de-456c-ace3-854153ff6575 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.316244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57106-54de-456c-ace3-854153ff6575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.316520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57106-54de-456c-ace3-854153ff6575 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.317182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad57106-54de-456c-ace3-854153ff6575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:33.322381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad57106-54de-456c-ace3-854153ff6575 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:33.339140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 980/1953] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:33.343350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad57106-54de-456c-ace3-854153ff6575 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:33.343350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2ad57106-54de-456c-ace3-854153ff6575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:33.360476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad57106-54de-456c-ace3-854153ff6575 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:33.362550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edbf47-f6cf-49e2-89ab-e01d853789b8 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:33.367854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4939b7-acda-4998-b1ef-015220e05950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:33.368710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4939b7-acda-4998-b1ef-015220e05950 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.369139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4939b7-acda-4998-b1ef-015220e05950 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.369580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4939b7-acda-4998-b1ef-015220e05950 admin admin] PATH_INFO: `/v3/projects/b003ebc90f64489f8229fab4969e1424/users/4f522300267f4690ac34e8d588b144ea/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.371953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4939b7-acda-4998-b1ef-015220e05950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b003ebc90f64489f8229fab4969e1424, user_id=4f522300267f4690ac34e8d588b144ea, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:33.372213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:33.372870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.373154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.374098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] PATH_INFO: `/v3/users/9d026d82b1604249b2d59f4890b98db6` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.375818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4939b7-acda-4998-b1ef-015220e05950 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:33.377054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d026d82b1604249b2d59f4890b98db6)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:33.379099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:33.389648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:33.390563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 981/1954] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:33 2022] PUT /identity/v3/projects/b003ebc90f64489f8229fab4969e1424/users/4f522300267f4690ac34e8d588b144ea/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:33.401814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340029-bde5-4534-8d78-a876f2d61700 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.402200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340029-bde5-4534-8d78-a876f2d61700 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.402571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340029-bde5-4534-8d78-a876f2d61700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.444028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-96340029-bde5-4534-8d78-a876f2d61700 None None] MFA Rules not processed for user `4f522300267f4690ac34e8d588b144ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:33.451698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-96340029-bde5-4534-8d78-a876f2d61700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:33.535777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:33.559885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 982/1955] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:33.591966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96340029-bde5-4534-8d78-a876f2d61700 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:33.593398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-96340029-bde5-4534-8d78-a876f2d61700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:33.650195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96340029-bde5-4534-8d78-a876f2d61700 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:33.653871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d415b1-71a4-48a3-9dd8-e572efccfd1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:33.654478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d415b1-71a4-48a3-9dd8-e572efccfd1e service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.654835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d415b1-71a4-48a3-9dd8-e572efccfd1e service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.655043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d415b1-71a4-48a3-9dd8-e572efccfd1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.656829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-43d415b1-71a4-48a3-9dd8-e572efccfd1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:33.669289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d026d82b1604249b2d59f4890b98db6'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.669972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d026d82b1604249b2d59f4890b98db6'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.670588 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d026d82b1604249b2d59f4890b98db6'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.684415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d026d82b1604249b2d59f4890b98db6'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.730512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d415b1-71a4-48a3-9dd8-e572efccfd1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:33.732004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d415b1-71a4-48a3-9dd8-e572efccfd1e service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:33.741908 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 983/1956] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:33.797094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3f1953f2-a961-4c40-b307-4f8ea59c9fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d026d82b1604249b2d59f4890b98db6'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:33.822093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 974/1957] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:33 2022] DELETE /identity/v3/users/9d026d82b1604249b2d59f4890b98db6 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:34.353442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d415b1-71a4-48a3-9dd8-e572efccfd1e service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:34.473288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d415b1-71a4-48a3-9dd8-e572efccfd1e service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:34.545451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:34.546117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:34.546400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:34.546677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] PATH_INFO: `/v3/projects/47b9e5d4e0c248b3b60bc1a03ee0cce4` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:34.547878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b9e5d4e0c248b3b60bc1a03ee0cce4)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:34.550452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:34.681717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b9e5d4e0c248b3b60bc1a03ee0cce4', 'request_id': 'req-df994872-b5d2-4884-92d4-54d133dcf313'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:34.689548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b9e5d4e0c248b3b60bc1a03ee0cce4', 'request_id': 'req-df994872-b5d2-4884-92d4-54d133dcf313'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:34.780916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b9e5d4e0c248b3b60bc1a03ee0cce4', 'request_id': 'req-df994872-b5d2-4884-92d4-54d133dcf313'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:34.799453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] The token cache is being invalidate because project 47b9e5d4e0c248b3b60bc1a03ee0cce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:34.800000 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:34.800744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-df994872-b5d2-4884-92d4-54d133dcf313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:34.808060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869e6b9-18b2-4318-90ad-905d51dbf27d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:34.808717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869e6b9-18b2-4318-90ad-905d51dbf27d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:34.809271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869e6b9-18b2-4318-90ad-905d51dbf27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:34.813899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 984/1958] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:34 2022] DELETE /identity/v3/projects/47b9e5d4e0c248b3b60bc1a03ee0cce4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:34.838177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-7869e6b9-18b2-4318-90ad-905d51dbf27d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:34.840474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7869e6b9-18b2-4318-90ad-905d51dbf27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:34.934637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad33bf-4dae-4f1a-940a-d44eacf26cea None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:34.935147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad33bf-4dae-4f1a-940a-d44eacf26cea None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:34.935464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad33bf-4dae-4f1a-940a-d44eacf26cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:34.939034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 975/1959] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:34.962559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-0fad33bf-4dae-4f1a-940a-d44eacf26cea None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:34.963885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0fad33bf-4dae-4f1a-940a-d44eacf26cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:34.972139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 985/1960] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:34.976567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869e6b9-18b2-4318-90ad-905d51dbf27d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:34.987191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869e6b9-18b2-4318-90ad-905d51dbf27d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:34.992530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca840ac-4079-4538-88a9-e8c0bab7d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:34.993145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca840ac-4079-4538-88a9-e8c0bab7d64e admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:34.993425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca840ac-4079-4538-88a9-e8c0bab7d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:34.993699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca840ac-4079-4538-88a9-e8c0bab7d64e admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:34.994450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca840ac-4079-4538-88a9-e8c0bab7d64e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:34.994789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca840ac-4079-4538-88a9-e8c0bab7d64e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:34.996481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca840ac-4079-4538-88a9-e8c0bab7d64e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:35.016463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 976/1961] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:35.016696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad33bf-4dae-4f1a-940a-d44eacf26cea None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:35.025362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad33bf-4dae-4f1a-940a-d44eacf26cea None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:35.030112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb976a4-1a44-4189-b597-e06651b63d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:35.030717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb976a4-1a44-4189-b597-e06651b63d43 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.031026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb976a4-1a44-4189-b597-e06651b63d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.031351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb976a4-1a44-4189-b597-e06651b63d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.031995 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb976a4-1a44-4189-b597-e06651b63d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:35.033944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb976a4-1a44-4189-b597-e06651b63d43 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:35.171492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 986/1962] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:35 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:55:35.180306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca840ac-4079-4538-88a9-e8c0bab7d64e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:35.206313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca840ac-4079-4538-88a9-e8c0bab7d64e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:35.309211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915fff1-6c5d-4f52-bd82-3c21e1642902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:35.309860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915fff1-6c5d-4f52-bd82-3c21e1642902 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.310174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915fff1-6c5d-4f52-bd82-3c21e1642902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.310528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915fff1-6c5d-4f52-bd82-3c21e1642902 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.311200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915fff1-6c5d-4f52-bd82-3c21e1642902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:35.313612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915fff1-6c5d-4f52-bd82-3c21e1642902 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:35.407300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 977/1963] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:35 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:55:35.411631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb976a4-1a44-4189-b597-e06651b63d43 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:35.423383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb976a4-1a44-4189-b597-e06651b63d43 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:35.428267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d838-cfcd-47eb-937b-deede6c9fe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:35.428969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d838-cfcd-47eb-937b-deede6c9fe0e admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.429350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d838-cfcd-47eb-937b-deede6c9fe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.429747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608d838-cfcd-47eb-937b-deede6c9fe0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.430543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608d838-cfcd-47eb-937b-deede6c9fe0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:35.432165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608d838-cfcd-47eb-937b-deede6c9fe0e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:35.443505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 987/1964] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:35.447787 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915fff1-6c5d-4f52-bd82-3c21e1642902 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:35.459641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915fff1-6c5d-4f52-bd82-3c21e1642902 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:35.464645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031584a-b533-404c-8c5a-f3b263f108e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:35.465323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031584a-b533-404c-8c5a-f3b263f108e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.465692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031584a-b533-404c-8c5a-f3b263f108e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.466036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031584a-b533-404c-8c5a-f3b263f108e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.466804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031584a-b533-404c-8c5a-f3b263f108e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:35.468455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031584a-b533-404c-8c5a-f3b263f108e1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:35.480658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 978/1965] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:35.485195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d838-cfcd-47eb-937b-deede6c9fe0e admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:35.495985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608d838-cfcd-47eb-937b-deede6c9fe0e admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:35.500496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bb648-d45e-4f9d-9939-0a2ea7bbc411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:35.501167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb648-d45e-4f9d-9939-0a2ea7bbc411 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.501480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb648-d45e-4f9d-9939-0a2ea7bbc411 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.501750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb648-d45e-4f9d-9939-0a2ea7bbc411 admin admin] PATH_INFO: `/v3/projects/29a9c962065549928ac5660fcc549926/users/5148ab0cf7a34b2c822a5d6eb896e7ed/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.516368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bb648-d45e-4f9d-9939-0a2ea7bbc411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a9c962065549928ac5660fcc549926, user_id=5148ab0cf7a34b2c822a5d6eb896e7ed, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:35.518999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bb648-d45e-4f9d-9939-0a2ea7bbc411 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:35.525995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:35.544971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031584a-b533-404c-8c5a-f3b263f108e1 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:35.546650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8031584a-b533-404c-8c5a-f3b263f108e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:35.559509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031584a-b533-404c-8c5a-f3b263f108e1 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:35.564514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:35.565182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.565463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.565739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] PATH_INFO: `/v3/users/ab5a74275a094eaf824f314402b00149` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.566925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5a74275a094eaf824f314402b00149)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:35.568995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:35.586798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 988/1966] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:35 2022] PUT /identity/v3/projects/29a9c962065549928ac5660fcc549926/users/5148ab0cf7a34b2c822a5d6eb896e7ed/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:35.597363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbb7ed-fcab-48d1-98f6-0fd527475e3d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.597656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbb7ed-fcab-48d1-98f6-0fd527475e3d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.597955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbb7ed-fcab-48d1-98f6-0fd527475e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.625462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-cbcbb7ed-fcab-48d1-98f6-0fd527475e3d None None] MFA Rules not processed for user `5148ab0cf7a34b2c822a5d6eb896e7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:35.626673 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cbcbb7ed-fcab-48d1-98f6-0fd527475e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:35.637692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:35.700634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 989/1967] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:35.705131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbb7ed-fcab-48d1-98f6-0fd527475e3d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:35.743247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5a74275a094eaf824f314402b00149'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:35.744160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5a74275a094eaf824f314402b00149'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:35.744756 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5a74275a094eaf824f314402b00149'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:35.759052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5a74275a094eaf824f314402b00149'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:35.785136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbb7ed-fcab-48d1-98f6-0fd527475e3d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:35.794372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d20bf-4263-44c2-80d1-cd30f4d554c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:35.794978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d20bf-4263-44c2-80d1-cd30f4d554c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.795607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d20bf-4263-44c2-80d1-cd30f4d554c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.795607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d20bf-4263-44c2-80d1-cd30f4d554c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.796342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d20bf-4263-44c2-80d1-cd30f4d554c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:35.798419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d20bf-4263-44c2-80d1-cd30f4d554c2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:35.838268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-861f3540-45af-4319-8fa0-f674282eee12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5a74275a094eaf824f314402b00149'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:35.871581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 979/1968] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:35 2022] DELETE /identity/v3/users/ab5a74275a094eaf824f314402b00149 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:35.875227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 990/1969] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:35 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:55:35.875776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac81190-4eae-4001-bb58-1061580bad37 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:35.876070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac81190-4eae-4001-bb58-1061580bad37 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:35.876351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac81190-4eae-4001-bb58-1061580bad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:35.876482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d20bf-4263-44c2-80d1-cd30f4d554c2 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:35.880058 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-eb9d20bf-4263-44c2-80d1-cd30f4d554c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:35.915098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-eac81190-4eae-4001-bb58-1061580bad37 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:35.915098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-eac81190-4eae-4001-bb58-1061580bad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:36.012512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d20bf-4263-44c2-80d1-cd30f4d554c2 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:36.079105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 980/1970] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:36.125891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac81190-4eae-4001-bb58-1061580bad37 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:36.126279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-eac81190-4eae-4001-bb58-1061580bad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:36.152931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:36.164899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83d827-a438-41ff-8128-aa57cd18e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:36.165934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d827-a438-41ff-8128-aa57cd18e4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.166389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d827-a438-41ff-8128-aa57cd18e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.166830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d827-a438-41ff-8128-aa57cd18e4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.167782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83d827-a438-41ff-8128-aa57cd18e4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:36.169899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83d827-a438-41ff-8128-aa57cd18e4f6 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:36.230342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac81190-4eae-4001-bb58-1061580bad37 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:36.236655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45582e-f739-4f03-a60b-788b45e1cedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:36.237662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45582e-f739-4f03-a60b-788b45e1cedd service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.237662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45582e-f739-4f03-a60b-788b45e1cedd service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.238037 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45582e-f739-4f03-a60b-788b45e1cedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.248695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45582e-f739-4f03-a60b-788b45e1cedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:36.250150 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45582e-f739-4f03-a60b-788b45e1cedd service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:36.261390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 981/1971] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:36.304428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 991/1972] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:35 2022] POST /identity/v3/users => generated 289 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:36.308350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45582e-f739-4f03-a60b-788b45e1cedd service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:36.321613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45582e-f739-4f03-a60b-788b45e1cedd service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:36.324817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2353cc-e92c-477b-90fb-5b6f44b2bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:36.325573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2353cc-e92c-477b-90fb-5b6f44b2bde1 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.325680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2353cc-e92c-477b-90fb-5b6f44b2bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.325986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2353cc-e92c-477b-90fb-5b6f44b2bde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.328502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2353cc-e92c-477b-90fb-5b6f44b2bde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:36.330018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2353cc-e92c-477b-90fb-5b6f44b2bde1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:36.362971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 982/1973] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:36.366728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83d827-a438-41ff-8128-aa57cd18e4f6 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:36.384776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83d827-a438-41ff-8128-aa57cd18e4f6 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:36.401030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7356e1-98cc-4327-ac25-cf20d89760ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:36.401030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7356e1-98cc-4327-ac25-cf20d89760ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.401030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7356e1-98cc-4327-ac25-cf20d89760ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.401030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7356e1-98cc-4327-ac25-cf20d89760ea admin admin] PATH_INFO: `/v3/projects/f2360b2099584a71a20f8599a705c43b/users/0553c12e685749458dcd1247c2462fd7/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.408782 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2353cc-e92c-477b-90fb-5b6f44b2bde1 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:36.412931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-aa2353cc-e92c-477b-90fb-5b6f44b2bde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:36.422577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7356e1-98cc-4327-ac25-cf20d89760ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2360b2099584a71a20f8599a705c43b, user_id=0553c12e685749458dcd1247c2462fd7, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:36.423155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7356e1-98cc-4327-ac25-cf20d89760ea admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:36.429404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2353cc-e92c-477b-90fb-5b6f44b2bde1 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:36.434633 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:36.435634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.435634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.435897 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] PATH_INFO: `/v3/users/a6f90db1483a44feaeee819701804474` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.437450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f90db1483a44feaeee819701804474)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:36.439420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:36.535401 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 992/1974] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:36 2022] PUT /identity/v3/projects/f2360b2099584a71a20f8599a705c43b/users/0553c12e685749458dcd1247c2462fd7/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:36.536266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7356e1-98cc-4327-ac25-cf20d89760ea admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:36.670009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7356e1-98cc-4327-ac25-cf20d89760ea admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:36.672156 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f90db1483a44feaeee819701804474'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:36.675968 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ed410-1bcc-4eff-929f-8a8a0961ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:36.676501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f90db1483a44feaeee819701804474'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:36.676785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ed410-1bcc-4eff-929f-8a8a0961ab16 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.677073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ed410-1bcc-4eff-929f-8a8a0961ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.677417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ed410-1bcc-4eff-929f-8a8a0961ab16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.677517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f90db1483a44feaeee819701804474'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:36.678062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ed410-1bcc-4eff-929f-8a8a0961ab16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:36.680298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ed410-1bcc-4eff-929f-8a8a0961ab16 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:36.692268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f90db1483a44feaeee819701804474'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:36.697594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 993/1975] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:36.701495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ed410-1bcc-4eff-929f-8a8a0961ab16 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:36.703554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-419ed410-1bcc-4eff-929f-8a8a0961ab16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:36.717338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ed410-1bcc-4eff-929f-8a8a0961ab16 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:36.722642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c68f3f-0e2f-470d-94ae-aea3d43ea028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:36.723401 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68f3f-0e2f-470d-94ae-aea3d43ea028 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.723692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68f3f-0e2f-470d-94ae-aea3d43ea028 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.725083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c68f3f-0e2f-470d-94ae-aea3d43ea028 admin admin] PATH_INFO: `/v3/projects/f2360b2099584a71a20f8599a705c43b/users/0553c12e685749458dcd1247c2462fd7/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.726446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c68f3f-0e2f-470d-94ae-aea3d43ea028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2360b2099584a71a20f8599a705c43b, user_id=0553c12e685749458dcd1247c2462fd7, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:36.729399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c68f3f-0e2f-470d-94ae-aea3d43ea028 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:36.744726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 994/1976] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:36 2022] PUT /identity/v3/projects/f2360b2099584a71a20f8599a705c43b/users/0553c12e685749458dcd1247c2462fd7/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:36.755141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290e241-ca90-42fc-80a2-30b4586c7224 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.756031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290e241-ca90-42fc-80a2-30b4586c7224 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.756350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290e241-ca90-42fc-80a2-30b4586c7224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.788437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b290e241-ca90-42fc-80a2-30b4586c7224 None None] MFA Rules not processed for user `0553c12e685749458dcd1247c2462fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:36.789656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b290e241-ca90-42fc-80a2-30b4586c7224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:36.803728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3c64ce79-65c2-4224-a6e3-a6fe4b314e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f90db1483a44feaeee819701804474'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:36.833580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 983/1977] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:36 2022] DELETE /identity/v3/users/a6f90db1483a44feaeee819701804474 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:36.839050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d921f-8964-4b47-b0c4-642d9b747a25 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.839821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d921f-8964-4b47-b0c4-642d9b747a25 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.840115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d921f-8964-4b47-b0c4-642d9b747a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.869650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-493d921f-8964-4b47-b0c4-642d9b747a25 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:36.871215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-493d921f-8964-4b47-b0c4-642d9b747a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:36.897089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 995/1978] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:36.898035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290e241-ca90-42fc-80a2-30b4586c7224 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:36.902658 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b290e241-ca90-42fc-80a2-30b4586c7224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:36.945603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 984/1979] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:36.947581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d921f-8964-4b47-b0c4-642d9b747a25 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:36.947895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-493d921f-8964-4b47-b0c4-642d9b747a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:36.982331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290e241-ca90-42fc-80a2-30b4586c7224 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:36.987749 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:36.988393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:36.988715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:36.989003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] PATH_INFO: `/v3/projects/358956167fd64083ac8ebbae682abe1a` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:36.990824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=358956167fd64083ac8ebbae682abe1a)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:36.992783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:37.026635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d921f-8964-4b47-b0c4-642d9b747a25 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:37.030634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614400b-7bbe-4852-b270-318bf6c6da55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:37.031282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614400b-7bbe-4852-b270-318bf6c6da55 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.031624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614400b-7bbe-4852-b270-318bf6c6da55 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.031899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614400b-7bbe-4852-b270-318bf6c6da55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.078576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358956167fd64083ac8ebbae682abe1a', 'request_id': 'req-3642df41-8fb1-4159-b265-507c7c05f5dc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.086463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358956167fd64083ac8ebbae682abe1a', 'request_id': 'req-3642df41-8fb1-4159-b265-507c7c05f5dc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.095833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614400b-7bbe-4852-b270-318bf6c6da55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:37.097366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614400b-7bbe-4852-b270-318bf6c6da55 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:37.108129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 985/1980] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:37.109019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614400b-7bbe-4852-b270-318bf6c6da55 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:37.110361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c614400b-7bbe-4852-b270-318bf6c6da55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.158943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358956167fd64083ac8ebbae682abe1a', 'request_id': 'req-3642df41-8fb1-4159-b265-507c7c05f5dc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.178971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] The token cache is being invalidate because project 358956167fd64083ac8ebbae682abe1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:37.179539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614400b-7bbe-4852-b270-318bf6c6da55 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:37.179913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.180932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.182711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 996/1981] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:36 2022] DELETE /identity/v3/projects/358956167fd64083ac8ebbae682abe1a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:37.184654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:37.186508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.204821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:37.251494 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:37.252846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.253137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.253420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.255370 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.262057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:37.273287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:37.274391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642df41-8fb1-4159-b265-507c7c05f5dc admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:37.274881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:37.280696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:37.287245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.287245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.287245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] PATH_INFO: `/v3/users/b121b1e092be449dad539976d53bb70e` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.287245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b121b1e092be449dad539976d53bb70e)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:37.287892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:37.289009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 986/1982] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:37.290093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:37.291589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.305866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc89ed-ace2-4df0-bf25-31762d45242c service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:37.311593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:37.312843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.313646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.313646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] PATH_INFO: `/v3/users/137c88b93a8644539bbc7469732eb1c1` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.316332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=137c88b93a8644539bbc7469732eb1c1)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:37.319870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:37.461875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b121b1e092be449dad539976d53bb70e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.462838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b121b1e092be449dad539976d53bb70e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.463989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b121b1e092be449dad539976d53bb70e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.509109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137c88b93a8644539bbc7469732eb1c1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.509943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137c88b93a8644539bbc7469732eb1c1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.510712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137c88b93a8644539bbc7469732eb1c1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.524311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137c88b93a8644539bbc7469732eb1c1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.568241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b121b1e092be449dad539976d53bb70e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.580520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b121b1e092be449dad539976d53bb70e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.593462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 997/1983] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:37 2022] DELETE /identity/v3/users/b121b1e092be449dad539976d53bb70e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:37.594280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:37.595690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.654873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137c88b93a8644539bbc7469732eb1c1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:37.664052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51ab4b-1521-4791-801f-09fc32eb9a03 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:37.669713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eba3e-ec86-4ce7-a996-33685d8ebd9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:37.670697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eba3e-ec86-4ce7-a996-33685d8ebd9a service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.671534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eba3e-ec86-4ce7-a996-33685d8ebd9a service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.672025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eba3e-ec86-4ce7-a996-33685d8ebd9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.674542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c49eba3e-ec86-4ce7-a996-33685d8ebd9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.687680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 987/1984] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:37 2022] DELETE /identity/v3/users/137c88b93a8644539bbc7469732eb1c1 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:37.691184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:37.695276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.762853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eba3e-ec86-4ce7-a996-33685d8ebd9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:37.764376 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eba3e-ec86-4ce7-a996-33685d8ebd9a service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:37.776895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 998/1985] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:37.778469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285be56-474c-4f02-b88a-468554bdd7ec None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.778766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285be56-474c-4f02-b88a-468554bdd7ec None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.779048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285be56-474c-4f02-b88a-468554bdd7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.817248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f285be56-474c-4f02-b88a-468554bdd7ec None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:37.823411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f285be56-474c-4f02-b88a-468554bdd7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.850500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:37.899177 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeb922-812a-4a87-bdc9-874b9bf41a26 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:37.913415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:37.914356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.914837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.916051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] PATH_INFO: `/v3/users/8771fc570c2241e8b311436e93c066de` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.920527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8771fc570c2241e8b311436e93c066de)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:37.925053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:37.944432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 999/1986] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:37.955339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285be56-474c-4f02-b88a-468554bdd7ec None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:37.957703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f285be56-474c-4f02-b88a-468554bdd7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:38.055230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285be56-474c-4f02-b88a-468554bdd7ec None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:38.068100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71fa7-c05a-4675-8bfb-579092455da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:38.069164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71fa7-c05a-4675-8bfb-579092455da4 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:38.069615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71fa7-c05a-4675-8bfb-579092455da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:38.070271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a71fa7-c05a-4675-8bfb-579092455da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:38.093561 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a71fa7-c05a-4675-8bfb-579092455da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:38.098012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a71fa7-c05a-4675-8bfb-579092455da4 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:38.126988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1000/1987] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:38.134568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71fa7-c05a-4675-8bfb-579092455da4 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:38.139070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c5a71fa7-c05a-4675-8bfb-579092455da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:38.165177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a71fa7-c05a-4675-8bfb-579092455da4 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:38.171172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:38.172031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:38.172439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:38.172622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] PATH_INFO: `/v3/projects/c7e3512785d34d06ad4949de1f1dd235` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:38.173828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e3512785d34d06ad4949de1f1dd235)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:38.180868 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:38.275041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8771fc570c2241e8b311436e93c066de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.276323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8771fc570c2241e8b311436e93c066de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.277353 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8771fc570c2241e8b311436e93c066de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.300204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8771fc570c2241e8b311436e93c066de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.357967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e3512785d34d06ad4949de1f1dd235', 'request_id': 'req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.364292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e3512785d34d06ad4949de1f1dd235', 'request_id': 'req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.397797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-37c377fe-b7d9-42c8-908c-040ff53bf17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8771fc570c2241e8b311436e93c066de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.411072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 988/1988] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:37 2022] DELETE /identity/v3/users/8771fc570c2241e8b311436e93c066de => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:38.416063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383a83-4d79-418c-bbbb-d2049f52e84a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:38.416399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383a83-4d79-418c-bbbb-d2049f52e84a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:38.416675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62383a83-4d79-418c-bbbb-d2049f52e84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:38.440527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-62383a83-4d79-418c-bbbb-d2049f52e84a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:38.440527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-62383a83-4d79-418c-bbbb-d2049f52e84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:38.500630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e3512785d34d06ad4949de1f1dd235', 'request_id': 'req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.516409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] The token cache is being invalidate because project c7e3512785d34d06ad4949de1f1dd235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:38.516759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.518070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.522264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1001/1989] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:38 2022] DELETE /identity/v3/projects/c7e3512785d34d06ad4949de1f1dd235 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:38.523383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:38.523517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 989/1990] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:38.524821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:38.526101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383a83-4d79-418c-bbbb-d2049f52e84a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:38.527587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-62383a83-4d79-418c-bbbb-d2049f52e84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:38.542710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62383a83-4d79-418c-bbbb-d2049f52e84a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:38.551264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:38.551653 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:38.552040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:38.552780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] PATH_INFO: `/v3/users/5e114957a39a46b3a0146c06ee7f3533` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:38.554921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e114957a39a46b3a0146c06ee7f3533)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:38.557436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:38.627535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9dbd7-4f46-46e5-8986-40fd7866d2e7 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:38.632681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:38.633392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:38.633746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:38.634087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] PATH_INFO: `/v3/projects/3fec0e6ee62f47cfbfc234451a83f51b` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:38.635181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fec0e6ee62f47cfbfc234451a83f51b)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:38.637133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:38.773954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e114957a39a46b3a0146c06ee7f3533'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.775119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e114957a39a46b3a0146c06ee7f3533'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.775899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e114957a39a46b3a0146c06ee7f3533'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.783993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fec0e6ee62f47cfbfc234451a83f51b', 'request_id': 'req-c14caaa4-5d95-49b9-b3ce-7293edaa9284'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.798892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fec0e6ee62f47cfbfc234451a83f51b', 'request_id': 'req-c14caaa4-5d95-49b9-b3ce-7293edaa9284'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.804725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e114957a39a46b3a0146c06ee7f3533'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.894059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fec0e6ee62f47cfbfc234451a83f51b', 'request_id': 'req-c14caaa4-5d95-49b9-b3ce-7293edaa9284'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.907487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] The token cache is being invalidate because project 3fec0e6ee62f47cfbfc234451a83f51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:38.907782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.908552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:38.914111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1002/1991] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:38 2022] DELETE /identity/v3/projects/3fec0e6ee62f47cfbfc234451a83f51b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:38.914111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:38.915172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:38.976470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14caaa4-5d95-49b9-b3ce-7293edaa9284 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:38.980220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada6439-4fe8-4af9-82d2-ec2b2b210fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:38.980825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada6439-4fe8-4af9-82d2-ec2b2b210fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:38.981110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada6439-4fe8-4af9-82d2-ec2b2b210fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:38.981389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada6439-4fe8-4af9-82d2-ec2b2b210fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:38.983628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-dada6439-4fe8-4af9-82d2-ec2b2b210fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:39.009813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:39.011618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e114957a39a46b3a0146c06ee7f3533'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.025923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 990/1992] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:38 2022] DELETE /identity/v3/users/5e114957a39a46b3a0146c06ee7f3533 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:39.030337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.031949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:39.060268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada6439-4fe8-4af9-82d2-ec2b2b210fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:39.061891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada6439-4fe8-4af9-82d2-ec2b2b210fa4 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:39.075331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1003/1993] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:39.076583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7334-7214-47ce-a6c0-24660f0d8e89 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.076808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7334-7214-47ce-a6c0-24660f0d8e89 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.077092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7334-7214-47ce-a6c0-24660f0d8e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.106847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b23f7334-7214-47ce-a6c0-24660f0d8e89 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:39.108287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b23f7334-7214-47ce-a6c0-24660f0d8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:39.119246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f22df-94b5-483a-9c19-44e0c77ebfcb admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:39.121603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1004/1994] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:39.127850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:39.128675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.129033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.129381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] PATH_INFO: `/v3/projects/b270937ffc3946e7a57d91351eeb6f0b` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.129535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fb45-1946-48a4-895c-7345ae9eb659 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.129810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fb45-1946-48a4-895c-7345ae9eb659 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.130091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fb45-1946-48a4-895c-7345ae9eb659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.132542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b270937ffc3946e7a57d91351eeb6f0b)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:39.136004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:39.183780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-26a2fb45-1946-48a4-895c-7345ae9eb659 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:39.183780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-26a2fb45-1946-48a4-895c-7345ae9eb659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:39.206396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1005/1995] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:39.211246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fb45-1946-48a4-895c-7345ae9eb659 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.222250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fb45-1946-48a4-895c-7345ae9eb659 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:39.228251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe1191-d76d-4c05-8a11-23e35530ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:39.229006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1191-d76d-4c05-8a11-23e35530ae12 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.229292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1191-d76d-4c05-8a11-23e35530ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.229611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1191-d76d-4c05-8a11-23e35530ae12 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.230225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe1191-d76d-4c05-8a11-23e35530ae12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:39.230529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe1191-d76d-4c05-8a11-23e35530ae12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:39.232194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe1191-d76d-4c05-8a11-23e35530ae12 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:39.247339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1006/1996] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:39.249263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe1191-d76d-4c05-8a11-23e35530ae12 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.262261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe1191-d76d-4c05-8a11-23e35530ae12 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:39.267561 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c405b2-0dab-4ffa-90ce-52dac183d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:39.268179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c405b2-0dab-4ffa-90ce-52dac183d8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.268464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c405b2-0dab-4ffa-90ce-52dac183d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.268741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c405b2-0dab-4ffa-90ce-52dac183d8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.269368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c405b2-0dab-4ffa-90ce-52dac183d8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:39.272119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c405b2-0dab-4ffa-90ce-52dac183d8c8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:39.414225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b270937ffc3946e7a57d91351eeb6f0b', 'request_id': 'req-67fb829a-561b-4ff2-970b-7b10ea3ab843'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.464177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1007/1997] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:39 2022] POST /identity/v3/projects => generated 365 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:55:39.472926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c405b2-0dab-4ffa-90ce-52dac183d8c8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.517442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b270937ffc3946e7a57d91351eeb6f0b', 'request_id': 'req-67fb829a-561b-4ff2-970b-7b10ea3ab843'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.527606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b270937ffc3946e7a57d91351eeb6f0b', 'request_id': 'req-67fb829a-561b-4ff2-970b-7b10ea3ab843'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.543215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] The token cache is being invalidate because project b270937ffc3946e7a57d91351eeb6f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:39.543746 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.548478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.550395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 991/1998] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:39 2022] DELETE /identity/v3/projects/b270937ffc3946e7a57d91351eeb6f0b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:39.558098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.560088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:39.570576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c405b2-0dab-4ffa-90ce-52dac183d8c8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:39.575577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd4e96-7769-4218-a9fb-53a538c3f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:39.576299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd4e96-7769-4218-a9fb-53a538c3f675 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.576491 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd4e96-7769-4218-a9fb-53a538c3f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.576736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd4e96-7769-4218-a9fb-53a538c3f675 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.577367 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd4e96-7769-4218-a9fb-53a538c3f675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:39.579760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd4e96-7769-4218-a9fb-53a538c3f675 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:39.644066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb829a-561b-4ff2-970b-7b10ea3ab843 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:39.650252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:39.650876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.651364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.651648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] PATH_INFO: `/v3/users/a98cba297d19454484884f18ea56bf7f` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.652920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98cba297d19454484884f18ea56bf7f)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:39.659750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:39.703697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1008/1999] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:39 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:55:39.706915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd4e96-7769-4218-a9fb-53a538c3f675 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.710014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f7fd4e96-7769-4218-a9fb-53a538c3f675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:39.728700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd4e96-7769-4218-a9fb-53a538c3f675 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:39.737939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d39ca-54f4-4fd5-9efa-0da50272e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:39.738558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d39ca-54f4-4fd5-9efa-0da50272e0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.738838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d39ca-54f4-4fd5-9efa-0da50272e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.739110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d39ca-54f4-4fd5-9efa-0da50272e0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.740571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d39ca-54f4-4fd5-9efa-0da50272e0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:39.742057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d39ca-54f4-4fd5-9efa-0da50272e0b2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:39.756906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1009/2000] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:39.758217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d39ca-54f4-4fd5-9efa-0da50272e0b2 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.768147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d39ca-54f4-4fd5-9efa-0da50272e0b2 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:39.773865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bf970-9f8f-48d4-aab1-5f5939c92017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:39.774562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf970-9f8f-48d4-aab1-5f5939c92017 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.774933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf970-9f8f-48d4-aab1-5f5939c92017 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.775261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf970-9f8f-48d4-aab1-5f5939c92017 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.776071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bf970-9f8f-48d4-aab1-5f5939c92017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:39.777756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bf970-9f8f-48d4-aab1-5f5939c92017 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:39.790118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1010/2001] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:39.794696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bf970-9f8f-48d4-aab1-5f5939c92017 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.814513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bf970-9f8f-48d4-aab1-5f5939c92017 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:39.815233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98cba297d19454484884f18ea56bf7f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.815233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98cba297d19454484884f18ea56bf7f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.816315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98cba297d19454484884f18ea56bf7f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.821216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c840c1-281e-4ec0-b513-d3f09955785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:39.821993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c840c1-281e-4ec0-b513-d3f09955785a admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.822160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c840c1-281e-4ec0-b513-d3f09955785a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.822443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c840c1-281e-4ec0-b513-d3f09955785a admin admin] PATH_INFO: `/v3/projects/f30efeaed8104b02acce6c3b86ece58e/users/ca0e2f681c3c4e099ec9fd5621342bfe/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.832998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98cba297d19454484884f18ea56bf7f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.845360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:39.855558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c840c1-281e-4ec0-b513-d3f09955785a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30efeaed8104b02acce6c3b86ece58e, user_id=ca0e2f681c3c4e099ec9fd5621342bfe, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:39.857883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c840c1-281e-4ec0-b513-d3f09955785a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:39.929065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98cba297d19454484884f18ea56bf7f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:39.935146 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1011/2002] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:39 2022] PUT /identity/v3/projects/f30efeaed8104b02acce6c3b86ece58e/users/ca0e2f681c3c4e099ec9fd5621342bfe/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:39.939055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c840c1-281e-4ec0-b513-d3f09955785a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.941178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-86c840c1-281e-4ec0-b513-d3f09955785a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:39.943605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 992/2003] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:39 2022] DELETE /identity/v3/users/a98cba297d19454484884f18ea56bf7f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:39.945318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.946675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.021855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad9a82-0f79-4834-80e8-09cc31c472c5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:40.027858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:40.028428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c840c1-281e-4ec0-b513-d3f09955785a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:40.028593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.028862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.029127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] PATH_INFO: `/v3/projects/e53133522bb943758279ab139fdf663d` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.030293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e53133522bb943758279ab139fdf663d)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:40.032391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:40.033240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:40.033876 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.034185 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.034449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] PATH_INFO: `/v3/projects/c5607c612e95421aaca050afba32fb78` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.035618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5607c612e95421aaca050afba32fb78)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:40.037567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:40.158537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e53133522bb943758279ab139fdf663d', 'request_id': 'req-86e526fe-872d-41e2-9f78-f134d0b62145'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.160301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5607c612e95421aaca050afba32fb78', 'request_id': 'req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.168090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5607c612e95421aaca050afba32fb78', 'request_id': 'req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.242586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e53133522bb943758279ab139fdf663d', 'request_id': 'req-86e526fe-872d-41e2-9f78-f134d0b62145'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.250113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e53133522bb943758279ab139fdf663d', 'request_id': 'req-86e526fe-872d-41e2-9f78-f134d0b62145'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.262529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] The token cache is being invalidate because project e53133522bb943758279ab139fdf663d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:40.262825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.264886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-86e526fe-872d-41e2-9f78-f134d0b62145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.265095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 993/2004] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:39 2022] DELETE /identity/v3/projects/e53133522bb943758279ab139fdf663d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:40.266451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9e07-a7ff-46e8-81b4-2fdb5d55bcc8 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.266743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9e07-a7ff-46e8-81b4-2fdb5d55bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.267142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9e07-a7ff-46e8-81b4-2fdb5d55bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.297632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-198f9e07-a7ff-46e8-81b4-2fdb5d55bcc8 None None] MFA Rules not processed for user `ca0e2f681c3c4e099ec9fd5621342bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:40.299004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-198f9e07-a7ff-46e8-81b4-2fdb5d55bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.323004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5607c612e95421aaca050afba32fb78', 'request_id': 'req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.344675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] The token cache is being invalidate because project c5607c612e95421aaca050afba32fb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:40.345010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.345902 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c24fc47e-bbf3-4f54-8c28-67b69f315ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.347928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1012/2005] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:39 2022] DELETE /identity/v3/projects/c5607c612e95421aaca050afba32fb78 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:40.349492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a825a-7adb-4503-9050-294779f540b0 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.349967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a825a-7adb-4503-9050-294779f540b0 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.350656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a825a-7adb-4503-9050-294779f540b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.390155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-368a825a-7adb-4503-9050-294779f540b0 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:40.390155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-368a825a-7adb-4503-9050-294779f540b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.395960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 994/2006] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:40.398037 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f9e07-a7ff-46e8-81b4-2fdb5d55bcc8 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:40.401389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-198f9e07-a7ff-46e8-81b4-2fdb5d55bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.478028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1013/2007] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:40.479354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a825a-7adb-4503-9050-294779f540b0 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:40.482182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-368a825a-7adb-4503-9050-294779f540b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.504542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a825a-7adb-4503-9050-294779f540b0 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:40.520147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1c2d0-f142-4439-9282-5f04cf1ebfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:40.521054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1c2d0-f142-4439-9282-5f04cf1ebfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.521337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1c2d0-f142-4439-9282-5f04cf1ebfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.521765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1c2d0-f142-4439-9282-5f04cf1ebfa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.522267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1c2d0-f142-4439-9282-5f04cf1ebfa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:40.525627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1c2d0-f142-4439-9282-5f04cf1ebfa8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:40.527166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f9e07-a7ff-46e8-81b4-2fdb5d55bcc8 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:40.544524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:40.545396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.545690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.553226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] PATH_INFO: `/v3/users/4f522300267f4690ac34e8d588b144ea` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.553226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f522300267f4690ac34e8d588b144ea)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:40.553226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:40.629217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1014/2008] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:40 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:40.630944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1c2d0-f142-4439-9282-5f04cf1ebfa8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:40.638809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-82c1c2d0-f142-4439-9282-5f04cf1ebfa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.716774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f522300267f4690ac34e8d588b144ea'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.717550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f522300267f4690ac34e8d588b144ea'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.718197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f522300267f4690ac34e8d588b144ea'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.732248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f522300267f4690ac34e8d588b144ea'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.736417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1c2d0-f142-4439-9282-5f04cf1ebfa8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:40.747230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:40.748016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.748400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.748695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] PATH_INFO: `/v3/projects/0ddb8757b6144484a247dcd68bf1f715` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.750745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddb8757b6144484a247dcd68bf1f715)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:40.751885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:40.791491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-646c18be-0d0f-48e2-8e79-e1ccc135eee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f522300267f4690ac34e8d588b144ea'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.807203 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 995/2009] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:40 2022] DELETE /identity/v3/users/4f522300267f4690ac34e8d588b144ea => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:40.808637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0117605-3a86-4cb4-a21c-8cf847803e66 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.809029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0117605-3a86-4cb4-a21c-8cf847803e66 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.809441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0117605-3a86-4cb4-a21c-8cf847803e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.841423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a0117605-3a86-4cb4-a21c-8cf847803e66 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:40.842556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a0117605-3a86-4cb4-a21c-8cf847803e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.919646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 996/2010] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:40.921129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0117605-3a86-4cb4-a21c-8cf847803e66 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:40.922770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a0117605-3a86-4cb4-a21c-8cf847803e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.926298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddb8757b6144484a247dcd68bf1f715', 'request_id': 'req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.935882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddb8757b6144484a247dcd68bf1f715', 'request_id': 'req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:40.936455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0117605-3a86-4cb4-a21c-8cf847803e66 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:40.995867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef3ce7-6a62-4f6f-8dee-c0a633d3b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:40.996485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef3ce7-6a62-4f6f-8dee-c0a633d3b152 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.996769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef3ce7-6a62-4f6f-8dee-c0a633d3b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.997045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef3ce7-6a62-4f6f-8dee-c0a633d3b152 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.997670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef3ce7-6a62-4f6f-8dee-c0a633d3b152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:40.999642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef3ce7-6a62-4f6f-8dee-c0a633d3b152 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.082965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:41.083678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddb8757b6144484a247dcd68bf1f715', 'request_id': 'req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:41.100197 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] The token cache is being invalidate because project 0ddb8757b6144484a247dcd68bf1f715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:41.100611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:41.109122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:41.109122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1015/2011] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:40 2022] DELETE /identity/v3/projects/0ddb8757b6144484a247dcd68bf1f715 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:41.109122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.109122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:41.129097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa7f9b-74ad-48f1-b1e6-4649a111e5f1 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.135455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 997/2012] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:40 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:41.136665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.137360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.137809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.137915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b742-a822-4a49-891d-b6c032ac78e5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.138663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b742-a822-4a49-891d-b6c032ac78e5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.138774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.138868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b742-a822-4a49-891d-b6c032ac78e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.139191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:41.139594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.141380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.158677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1016/2013] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:41.159703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.165865 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:41.181474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b73a90-dac2-4efb-9c24-e9c271c6e18e admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.184595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-9eb8b742-a822-4a49-891d-b6c032ac78e5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:41.186084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9eb8b742-a822-4a49-891d-b6c032ac78e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:41.188082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18789d-14df-4ccc-9db1-5fb2d3fae527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.189762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18789d-14df-4ccc-9db1-5fb2d3fae527 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.189762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18789d-14df-4ccc-9db1-5fb2d3fae527 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.189762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18789d-14df-4ccc-9db1-5fb2d3fae527 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.190256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18789d-14df-4ccc-9db1-5fb2d3fae527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.192210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18789d-14df-4ccc-9db1-5fb2d3fae527 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.198154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 998/2014] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:41.199321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b742-a822-4a49-891d-b6c032ac78e5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.211051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b742-a822-4a49-891d-b6c032ac78e5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.214638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1017/2015] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:41.216480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d2333-cf72-4358-b399-06ecb4204824 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.220133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d2333-cf72-4358-b399-06ecb4204824 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.220133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d2333-cf72-4358-b399-06ecb4204824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.221330 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb03d2-e476-43bc-aea3-0ee7b2ffd9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.222342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb03d2-e476-43bc-aea3-0ee7b2ffd9bb admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.222818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb03d2-e476-43bc-aea3-0ee7b2ffd9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.223390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb03d2-e476-43bc-aea3-0ee7b2ffd9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.225077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb03d2-e476-43bc-aea3-0ee7b2ffd9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.229398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb03d2-e476-43bc-aea3-0ee7b2ffd9bb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.238516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:41.241333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d65d2333-cf72-4358-b399-06ecb4204824 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:41.242971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d65d2333-cf72-4358-b399-06ecb4204824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:41.258049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1018/2016] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:41.260195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d2333-cf72-4358-b399-06ecb4204824 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.270224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d2333-cf72-4358-b399-06ecb4204824 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.276101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae524bd9-9b0a-42f3-b471-5b5e9e4a2da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.277028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524bd9-9b0a-42f3-b471-5b5e9e4a2da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.277308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524bd9-9b0a-42f3-b471-5b5e9e4a2da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.277583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524bd9-9b0a-42f3-b471-5b5e9e4a2da8 admin admin] PATH_INFO: `/v3/projects/d7264694b48b442b8765d7fcca0af470/users/8a2f878bd31446d98a3821c2830b6dbc/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.295590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae524bd9-9b0a-42f3-b471-5b5e9e4a2da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7264694b48b442b8765d7fcca0af470, user_id=8a2f878bd31446d98a3821c2830b6dbc, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.298820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae524bd9-9b0a-42f3-b471-5b5e9e4a2da8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.351437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 999/2017] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:41 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:41.351437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb03d2-e476-43bc-aea3-0ee7b2ffd9bb admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.381562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1019/2018] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:41 2022] PUT /identity/v3/projects/d7264694b48b442b8765d7fcca0af470/users/8a2f878bd31446d98a3821c2830b6dbc/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:41.383253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae524bd9-9b0a-42f3-b471-5b5e9e4a2da8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.445211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb03d2-e476-43bc-aea3-0ee7b2ffd9bb admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.484335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae524bd9-9b0a-42f3-b471-5b5e9e4a2da8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.495482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a824f62-f9d6-43d8-8cf4-bd5c9985737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.496519 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a824f62-f9d6-43d8-8cf4-bd5c9985737b admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.496993 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a824f62-f9d6-43d8-8cf4-bd5c9985737b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.498082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a824f62-f9d6-43d8-8cf4-bd5c9985737b admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.498878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a824f62-f9d6-43d8-8cf4-bd5c9985737b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.500900 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a824f62-f9d6-43d8-8cf4-bd5c9985737b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.529507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.530477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.530941 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.531474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.532728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:41.533865 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.536100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.551178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1000/2019] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:41.556086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.572207 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:41.588712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fa992-f70c-42ba-a2d8-f53d2eab06d9 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.589461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1020/2020] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:41 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:41.591039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a824f62-f9d6-43d8-8cf4-bd5c9985737b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.594402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.595278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.595680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.596412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] PATH_INFO: `/v3/projects/b003ebc90f64489f8229fab4969e1424` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.597818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b003ebc90f64489f8229fab4969e1424)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.601045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.607171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a824f62-f9d6-43d8-8cf4-bd5c9985737b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.612664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6539a5-19de-4ea0-b564-1dffc7407e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.613322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6539a5-19de-4ea0-b564-1dffc7407e53 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.615243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6539a5-19de-4ea0-b564-1dffc7407e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.615243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6539a5-19de-4ea0-b564-1dffc7407e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.615243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6539a5-19de-4ea0-b564-1dffc7407e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.617003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6539a5-19de-4ea0-b564-1dffc7407e53 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.631633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1021/2021] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:41.631633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6539a5-19de-4ea0-b564-1dffc7407e53 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.641757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6539a5-19de-4ea0-b564-1dffc7407e53 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.646567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077feda6-1d8c-490d-b215-b0d29068b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.647219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077feda6-1d8c-490d-b215-b0d29068b53e admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.647542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077feda6-1d8c-490d-b215-b0d29068b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.647800 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077feda6-1d8c-490d-b215-b0d29068b53e admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.648422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077feda6-1d8c-490d-b215-b0d29068b53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.650304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077feda6-1d8c-490d-b215-b0d29068b53e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.722223 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b003ebc90f64489f8229fab4969e1424', 'request_id': 'req-700791b8-f977-4110-aace-c90e03b3fc74'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:41.753710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1022/2022] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:41 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:41.753710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077feda6-1d8c-490d-b215-b0d29068b53e admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.835397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077feda6-1d8c-490d-b215-b0d29068b53e admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.837605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b003ebc90f64489f8229fab4969e1424', 'request_id': 'req-700791b8-f977-4110-aace-c90e03b3fc74'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:41.840671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52928754-71d2-4541-ad2d-ffcbfc56e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.841293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928754-71d2-4541-ad2d-ffcbfc56e1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.841574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928754-71d2-4541-ad2d-ffcbfc56e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.841857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928754-71d2-4541-ad2d-ffcbfc56e1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.842502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52928754-71d2-4541-ad2d-ffcbfc56e1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.844250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52928754-71d2-4541-ad2d-ffcbfc56e1e0 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.851222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b003ebc90f64489f8229fab4969e1424', 'request_id': 'req-700791b8-f977-4110-aace-c90e03b3fc74'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:41.866953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1023/2023] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:41.866953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52928754-71d2-4541-ad2d-ffcbfc56e1e0 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.882691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52928754-71d2-4541-ad2d-ffcbfc56e1e0 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.905682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec59e4-824b-441b-af1c-4f63e9192dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.909781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] The token cache is being invalidate because project b003ebc90f64489f8229fab4969e1424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:41.909894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec59e4-824b-441b-af1c-4f63e9192dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.909894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec59e4-824b-441b-af1c-4f63e9192dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.910025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:41.910092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec59e4-824b-441b-af1c-4f63e9192dcc admin admin] PATH_INFO: `/v3/projects/d7264694b48b442b8765d7fcca0af470/users/8a2f878bd31446d98a3821c2830b6dbc/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.910176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:41.910246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec59e4-824b-441b-af1c-4f63e9192dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7264694b48b442b8765d7fcca0af470, user_id=8a2f878bd31446d98a3821c2830b6dbc, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.913399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec59e4-824b-441b-af1c-4f63e9192dcc admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.916144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1001/2024] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:41 2022] DELETE /identity/v3/projects/b003ebc90f64489f8229fab4969e1424 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:41.919432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.921836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:41.925422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1024/2025] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:41 2022] PUT /identity/v3/projects/d7264694b48b442b8765d7fcca0af470/users/8a2f878bd31446d98a3821c2830b6dbc/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:41.926085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec59e4-824b-441b-af1c-4f63e9192dcc admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.935629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-86ec59e4-824b-441b-af1c-4f63e9192dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:42.035713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec59e4-824b-441b-af1c-4f63e9192dcc admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:42.036271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700791b8-f977-4110-aace-c90e03b3fc74 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:42.041480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61452425-2f23-49fc-bfbd-63b50a882f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:42.041704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5a114-b0a6-4672-b0f4-004edb2ad64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:42.042086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61452425-2f23-49fc-bfbd-63b50a882f73 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.042326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5a114-b0a6-4672-b0f4-004edb2ad64f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.042445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61452425-2f23-49fc-bfbd-63b50a882f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.042624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5a114-b0a6-4672-b0f4-004edb2ad64f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.042748 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61452425-2f23-49fc-bfbd-63b50a882f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.043249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5a114-b0a6-4672-b0f4-004edb2ad64f admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.043381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61452425-2f23-49fc-bfbd-63b50a882f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:42.043905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5a114-b0a6-4672-b0f4-004edb2ad64f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:42.047586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61452425-2f23-49fc-bfbd-63b50a882f73 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:42.047689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5a114-b0a6-4672-b0f4-004edb2ad64f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:42.055871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1025/2026] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:42.056977 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5ecc-8ce9-448b-8b73-bcf5cb068460 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.057275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5ecc-8ce9-448b-8b73-bcf5cb068460 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.057674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5ecc-8ce9-448b-8b73-bcf5cb068460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.084768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-75ea5ecc-8ce9-448b-8b73-bcf5cb068460 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:42.086024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-75ea5ecc-8ce9-448b-8b73-bcf5cb068460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:42.102255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1026/2027] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:42.104104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547fea1-e138-439e-997a-1e4114fbb6a6 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.104401 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547fea1-e138-439e-997a-1e4114fbb6a6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.104678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547fea1-e138-439e-997a-1e4114fbb6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.132064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1002/2028] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:41 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:42.134096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5a114-b0a6-4672-b0f4-004edb2ad64f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:42.142600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-6547fea1-e138-439e-997a-1e4114fbb6a6 None None] MFA Rules not processed for user `8a2f878bd31446d98a3821c2830b6dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:42.144568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6547fea1-e138-439e-997a-1e4114fbb6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:42.154788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5a114-b0a6-4672-b0f4-004edb2ad64f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:42.161963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b6b64-bb2d-4be3-ada2-b4a3a5576e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:42.162903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b6b64-bb2d-4be3-ada2-b4a3a5576e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.163558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b6b64-bb2d-4be3-ada2-b4a3a5576e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.164068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b6b64-bb2d-4be3-ada2-b4a3a5576e0e admin admin] PATH_INFO: `/v3/projects/489377cacb6748508fc9e284aa44f845/users/6255bd8749744af0adff7c9928ac9ae6/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.180975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b6b64-bb2d-4be3-ada2-b4a3a5576e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=489377cacb6748508fc9e284aa44f845, user_id=6255bd8749744af0adff7c9928ac9ae6, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:42.183867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b6b64-bb2d-4be3-ada2-b4a3a5576e0e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:42.244205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1003/2029] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:42 2022] PUT /identity/v3/projects/489377cacb6748508fc9e284aa44f845/users/6255bd8749744af0adff7c9928ac9ae6/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:42.244205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced311-adb3-4f74-a82b-f831f1138996 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.244205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced311-adb3-4f74-a82b-f831f1138996 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.244205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced311-adb3-4f74-a82b-f831f1138996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.259228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-27ced311-adb3-4f74-a82b-f831f1138996 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:42.260315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1027/2030] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:42.260876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-27ced311-adb3-4f74-a82b-f831f1138996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:42.267657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547fea1-e138-439e-997a-1e4114fbb6a6 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:42.285374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547fea1-e138-439e-997a-1e4114fbb6a6 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:42.354606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1004/2031] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:42.355929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7a2a7-3a23-42a9-abfb-33c170245167 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.356216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7a2a7-3a23-42a9-abfb-33c170245167 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.356491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7a2a7-3a23-42a9-abfb-33c170245167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.371542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192737-71cf-40df-85dd-43d507955604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:42.372336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192737-71cf-40df-85dd-43d507955604 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.373306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192737-71cf-40df-85dd-43d507955604 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.373642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192737-71cf-40df-85dd-43d507955604 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.374513 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192737-71cf-40df-85dd-43d507955604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:42.376122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192737-71cf-40df-85dd-43d507955604 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:42.388544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1028/2032] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:42.389486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192737-71cf-40df-85dd-43d507955604 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:42.393133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a5192737-71cf-40df-85dd-43d507955604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:42.407041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e8d7a2a7-3a23-42a9-abfb-33c170245167 None None] MFA Rules not processed for user `6255bd8749744af0adff7c9928ac9ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:42.408487 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e8d7a2a7-3a23-42a9-abfb-33c170245167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:42.470060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:42.519836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:42.529978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192737-71cf-40df-85dd-43d507955604 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:42.540776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504d9b5-9eb3-46aa-ba09-ef317cc7a8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:42.541398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504d9b5-9eb3-46aa-ba09-ef317cc7a8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.541678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504d9b5-9eb3-46aa-ba09-ef317cc7a8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.541949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504d9b5-9eb3-46aa-ba09-ef317cc7a8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.578607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1005/2033] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:42.580063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7a2a7-3a23-42a9-abfb-33c170245167 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:42.604561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7a2a7-3a23-42a9-abfb-33c170245167 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:42.620317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9cd91-0e77-4885-90b4-b54e6873ca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:42.625969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9cd91-0e77-4885-90b4-b54e6873ca13 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.625969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9cd91-0e77-4885-90b4-b54e6873ca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.625969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9cd91-0e77-4885-90b4-b54e6873ca13 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.625969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9cd91-0e77-4885-90b4-b54e6873ca13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:42.625969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9cd91-0e77-4885-90b4-b54e6873ca13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:42.625969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9cd91-0e77-4885-90b4-b54e6873ca13 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:42.644015 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1006/2034] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:42.645007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9cd91-0e77-4885-90b4-b54e6873ca13 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:42.656702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9cd91-0e77-4885-90b4-b54e6873ca13 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:42.666728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eba56f-f32f-413c-9b09-f6f66e1baa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:42.667387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba56f-f32f-413c-9b09-f6f66e1baa8b admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.668433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba56f-f32f-413c-9b09-f6f66e1baa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.668826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba56f-f32f-413c-9b09-f6f66e1baa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.669496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eba56f-f32f-413c-9b09-f6f66e1baa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:42.671149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504d9b5-9eb3-46aa-ba09-ef317cc7a8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:42.673028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504d9b5-9eb3-46aa-ba09-ef317cc7a8f8 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:42.673437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eba56f-f32f-413c-9b09-f6f66e1baa8b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:42.695886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1029/2035] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:42.697799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504d9b5-9eb3-46aa-ba09-ef317cc7a8f8 service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:42.716209 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1007/2036] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:42.716901 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504d9b5-9eb3-46aa-ba09-ef317cc7a8f8 service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:42.717100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eba56f-f32f-413c-9b09-f6f66e1baa8b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:42.732741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eba56f-f32f-413c-9b09-f6f66e1baa8b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:42.733639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beb6b6-f53a-468a-b18b-2f763631c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:42.734345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beb6b6-f53a-468a-b18b-2f763631c6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.734812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beb6b6-f53a-468a-b18b-2f763631c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.735279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beb6b6-f53a-468a-b18b-2f763631c6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.736266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beb6b6-f53a-468a-b18b-2f763631c6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:42.738077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d79be8-0a88-4b90-b7a5-4919899975bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:42.738782 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d79be8-0a88-4b90-b7a5-4919899975bb admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:42.739024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d79be8-0a88-4b90-b7a5-4919899975bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:42.739276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d79be8-0a88-4b90-b7a5-4919899975bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:42.740010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d79be8-0a88-4b90-b7a5-4919899975bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:42.742484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d79be8-0a88-4b90-b7a5-4919899975bb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:42.742628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beb6b6-f53a-468a-b18b-2f763631c6c9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:42.841584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1008/2037] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:42 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:42.841879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1030/2038] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:42 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:42.844859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beb6b6-f53a-468a-b18b-2f763631c6c9 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:42.847660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d79be8-0a88-4b90-b7a5-4919899975bb admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:42.971621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d79be8-0a88-4b90-b7a5-4919899975bb admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.009269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beb6b6-f53a-468a-b18b-2f763631c6c9 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.014488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41435cc-80c4-4b75-9619-d243c22a20f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.015542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41435cc-80c4-4b75-9619-d243c22a20f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.015923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41435cc-80c4-4b75-9619-d243c22a20f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.016296 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41435cc-80c4-4b75-9619-d243c22a20f9 admin admin] PATH_INFO: `/v3/projects/2f785379f88247418a8bacbf423122b5/users/9ff13ca197744158b14abd7ea51680ea/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.052876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9199a-2550-44ce-9947-30721296121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.053689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9199a-2550-44ce-9947-30721296121a admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.053968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9199a-2550-44ce-9947-30721296121a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.054252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9199a-2550-44ce-9947-30721296121a admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.054873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9199a-2550-44ce-9947-30721296121a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.057104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9199a-2550-44ce-9947-30721296121a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.063106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:43.085860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41435cc-80c4-4b75-9619-d243c22a20f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f785379f88247418a8bacbf423122b5, user_id=9ff13ca197744158b14abd7ea51680ea, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.091453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41435cc-80c4-4b75-9619-d243c22a20f9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.180757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1009/2039] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:42 2022] POST /identity/v3/users => generated 295 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:43.182265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9199a-2550-44ce-9947-30721296121a admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.192395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9199a-2550-44ce-9947-30721296121a admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.197875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1087938-1a80-4519-be9a-44abcc610b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.198491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1087938-1a80-4519-be9a-44abcc610b87 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.198770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1087938-1a80-4519-be9a-44abcc610b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.199071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1087938-1a80-4519-be9a-44abcc610b87 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.199732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1087938-1a80-4519-be9a-44abcc610b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.201690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1087938-1a80-4519-be9a-44abcc610b87 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.231696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1031/2040] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:42 2022] PUT /identity/v3/projects/2f785379f88247418a8bacbf423122b5/users/9ff13ca197744158b14abd7ea51680ea/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:43.231696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41435cc-80c4-4b75-9619-d243c22a20f9 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.285772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41435cc-80c4-4b75-9619-d243c22a20f9 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.290227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5da14-f1f7-4f52-abcb-5df9f7ff857f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.290813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5da14-f1f7-4f52-abcb-5df9f7ff857f service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.291088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5da14-f1f7-4f52-abcb-5df9f7ff857f service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.291392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5da14-f1f7-4f52-abcb-5df9f7ff857f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.293155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c2c5da14-f1f7-4f52-abcb-5df9f7ff857f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:43.311634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1010/2041] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:43 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:43.312755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1087938-1a80-4519-be9a-44abcc610b87 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.322624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1087938-1a80-4519-be9a-44abcc610b87 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.366345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5da14-f1f7-4f52-abcb-5df9f7ff857f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.368008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5da14-f1f7-4f52-abcb-5df9f7ff857f service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.378208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1032/2042] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:43.379758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea5b10-f1e2-4242-a33f-66bf53351e18 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.380311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea5b10-f1e2-4242-a33f-66bf53351e18 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.380526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea5b10-f1e2-4242-a33f-66bf53351e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.399045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77560-e881-47cf-8b8b-f83bbe967f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.400417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77560-e881-47cf-8b8b-f83bbe967f6f admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.401190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77560-e881-47cf-8b8b-f83bbe967f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.401804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77560-e881-47cf-8b8b-f83bbe967f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.402940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd77560-e881-47cf-8b8b-f83bbe967f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.404933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd77560-e881-47cf-8b8b-f83bbe967f6f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.419419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1fea5b10-f1e2-4242-a33f-66bf53351e18 None None] MFA Rules not processed for user `9ff13ca197744158b14abd7ea51680ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:43.421766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:43.431828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1011/2043] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:43.433505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1fea5b10-f1e2-4242-a33f-66bf53351e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:43.433585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77560-e881-47cf-8b8b-f83bbe967f6f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.440284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77560-e881-47cf-8b8b-f83bbe967f6f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.449589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d9c26-ef15-40a1-8f29-c249bb4e1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.450532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d9c26-ef15-40a1-8f29-c249bb4e1d67 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.451014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d9c26-ef15-40a1-8f29-c249bb4e1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.451799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d9c26-ef15-40a1-8f29-c249bb4e1d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.452479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d9c26-ef15-40a1-8f29-c249bb4e1d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.454190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d9c26-ef15-40a1-8f29-c249bb4e1d67 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.470100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1012/2044] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:43.470714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d9c26-ef15-40a1-8f29-c249bb4e1d67 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.490467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d9c26-ef15-40a1-8f29-c249bb4e1d67 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.496394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ee367-c06b-4b23-a858-bddf0c82052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.497104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ee367-c06b-4b23-a858-bddf0c82052c admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.497369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ee367-c06b-4b23-a858-bddf0c82052c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.497790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ee367-c06b-4b23-a858-bddf0c82052c admin admin] PATH_INFO: `/v3/projects/3721bb96c63c45a6bb347116a71a76ce/users/f0d394be36c1444a9dab32297734bc9d/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.522242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1033/2045] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:43.523659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea5b10-f1e2-4242-a33f-66bf53351e18 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.534521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ee367-c06b-4b23-a858-bddf0c82052c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3721bb96c63c45a6bb347116a71a76ce, user_id=f0d394be36c1444a9dab32297734bc9d, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.537572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ee367-c06b-4b23-a858-bddf0c82052c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.544950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea5b10-f1e2-4242-a33f-66bf53351e18 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.554334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e87bd-579a-4b29-9bb0-0d8224df7470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.555127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e87bd-579a-4b29-9bb0-0d8224df7470 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.555453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e87bd-579a-4b29-9bb0-0d8224df7470 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.556432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e87bd-579a-4b29-9bb0-0d8224df7470 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.556432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e87bd-579a-4b29-9bb0-0d8224df7470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.558120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e87bd-579a-4b29-9bb0-0d8224df7470 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.571887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1034/2046] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:43.572739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e87bd-579a-4b29-9bb0-0d8224df7470 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.583344 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e87bd-579a-4b29-9bb0-0d8224df7470 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.588683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e168f7-c9e8-46e1-a510-b3bb01a64f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.591976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e168f7-c9e8-46e1-a510-b3bb01a64f2a admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.592300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e168f7-c9e8-46e1-a510-b3bb01a64f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.593037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e168f7-c9e8-46e1-a510-b3bb01a64f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.593213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e168f7-c9e8-46e1-a510-b3bb01a64f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.595252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e168f7-c9e8-46e1-a510-b3bb01a64f2a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.637957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1013/2047] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:43 2022] PUT /identity/v3/projects/3721bb96c63c45a6bb347116a71a76ce/users/f0d394be36c1444a9dab32297734bc9d/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:43.638921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ee367-c06b-4b23-a858-bddf0c82052c admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.680612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1035/2048] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:43 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:43.681492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e168f7-c9e8-46e1-a510-b3bb01a64f2a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.745834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ee367-c06b-4b23-a858-bddf0c82052c admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.793981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:43.795354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e168f7-c9e8-46e1-a510-b3bb01a64f2a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.800269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bdd27-f4a6-4492-a038-3c6893a3648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.800691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bdd27-f4a6-4492-a038-3c6893a3648d admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.800974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bdd27-f4a6-4492-a038-3c6893a3648d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.801246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bdd27-f4a6-4492-a038-3c6893a3648d admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.802013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bdd27-f4a6-4492-a038-3c6893a3648d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.803806 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bdd27-f4a6-4492-a038-3c6893a3648d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.815466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1036/2049] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:43.816744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bdd27-f4a6-4492-a038-3c6893a3648d admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.830028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bdd27-f4a6-4492-a038-3c6893a3648d admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.835965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae37a-4e45-4078-9b7d-9aad5832fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.836664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae37a-4e45-4078-9b7d-9aad5832fb9f admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.837050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae37a-4e45-4078-9b7d-9aad5832fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.837334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae37a-4e45-4078-9b7d-9aad5832fb9f admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.837967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae37a-4e45-4078-9b7d-9aad5832fb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.840138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae37a-4e45-4078-9b7d-9aad5832fb9f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.842893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706e8a0-e9da-49db-9bc5-c159cb2afc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.843852 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706e8a0-e9da-49db-9bc5-c159cb2afc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.844456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706e8a0-e9da-49db-9bc5-c159cb2afc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.844695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706e8a0-e9da-49db-9bc5-c159cb2afc36 admin admin] PATH_INFO: `/v3/projects/7777758be78a46b7b51b52c18d1cdd14/users/c51868a65e084f738b380535f315030f/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.869390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706e8a0-e9da-49db-9bc5-c159cb2afc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7777758be78a46b7b51b52c18d1cdd14, user_id=c51868a65e084f738b380535f315030f, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.872262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706e8a0-e9da-49db-9bc5-c159cb2afc36 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.879140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:43.949656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1037/2050] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:43 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:43.949656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae37a-4e45-4078-9b7d-9aad5832fb9f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.960185 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae37a-4e45-4078-9b7d-9aad5832fb9f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:43.966762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0956a19-6646-4417-be33-94f36fd8c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:43.967464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0956a19-6646-4417-be33-94f36fd8c5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.967982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0956a19-6646-4417-be33-94f36fd8c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.968272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0956a19-6646-4417-be33-94f36fd8c5fd admin admin] PATH_INFO: `/v3/projects/3721bb96c63c45a6bb347116a71a76ce/users/f0d394be36c1444a9dab32297734bc9d/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.973719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1014/2051] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:43 2022] PUT /identity/v3/projects/7777758be78a46b7b51b52c18d1cdd14/users/c51868a65e084f738b380535f315030f/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:43.973869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0956a19-6646-4417-be33-94f36fd8c5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3721bb96c63c45a6bb347116a71a76ce, user_id=f0d394be36c1444a9dab32297734bc9d, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:43.973966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706e8a0-e9da-49db-9bc5-c159cb2afc36 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:43.974184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0956a19-6646-4417-be33-94f36fd8c5fd admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:43.986229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1038/2052] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:43 2022] PUT /identity/v3/projects/3721bb96c63c45a6bb347116a71a76ce/users/f0d394be36c1444a9dab32297734bc9d/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:43.987928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f72d7-2b87-47f5-a333-38e570d145d2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.988219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f72d7-2b87-47f5-a333-38e570d145d2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.988582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f72d7-2b87-47f5-a333-38e570d145d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.012712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-059f72d7-2b87-47f5-a333-38e570d145d2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:44.013930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-059f72d7-2b87-47f5-a333-38e570d145d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:44.059944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706e8a0-e9da-49db-9bc5-c159cb2afc36 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:44.082646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1039/2053] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:44.084772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85785299-a9cc-453f-8be8-c4a31b11ddd1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.085071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85785299-a9cc-453f-8be8-c4a31b11ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.085344 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85785299-a9cc-453f-8be8-c4a31b11ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.148247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-85785299-a9cc-453f-8be8-c4a31b11ddd1 None None] MFA Rules not processed for user `f0d394be36c1444a9dab32297734bc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:44.157982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-85785299-a9cc-453f-8be8-c4a31b11ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:44.162275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430e507-d50d-43f6-9731-42b4b731e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:44.163084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430e507-d50d-43f6-9731-42b4b731e0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.163550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430e507-d50d-43f6-9731-42b4b731e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.163831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430e507-d50d-43f6-9731-42b4b731e0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.164486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430e507-d50d-43f6-9731-42b4b731e0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:44.166093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430e507-d50d-43f6-9731-42b4b731e0a8 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:44.189592 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1015/2054] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:44.191158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430e507-d50d-43f6-9731-42b4b731e0a8 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:44.204642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8430e507-d50d-43f6-9731-42b4b731e0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:44.256436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1040/2055] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:44.263551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85785299-a9cc-453f-8be8-c4a31b11ddd1 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:44.277161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85785299-a9cc-453f-8be8-c4a31b11ddd1 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:44.279781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430e507-d50d-43f6-9731-42b4b731e0a8 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:44.283618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e361337-4efe-4b6e-8899-beef5c29e259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:44.286956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361337-4efe-4b6e-8899-beef5c29e259 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.286956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361337-4efe-4b6e-8899-beef5c29e259 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.286956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e361337-4efe-4b6e-8899-beef5c29e259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.287191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1374-acc4-4929-823e-b8319d3bdf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:44.287191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1374-acc4-4929-823e-b8319d3bdf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.287191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1374-acc4-4929-823e-b8319d3bdf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.287458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1374-acc4-4929-823e-b8319d3bdf77 admin admin] PATH_INFO: `/v3/projects/9385533778214db4a511b47689beccff/users/f9e40888ea7c4ac0b023a0e2ea756348/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.295587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e361337-4efe-4b6e-8899-beef5c29e259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:44.297031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e361337-4efe-4b6e-8899-beef5c29e259 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:44.303631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a1374-acc4-4929-823e-b8319d3bdf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9385533778214db4a511b47689beccff, user_id=f9e40888ea7c4ac0b023a0e2ea756348, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:44.306314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a1374-acc4-4929-823e-b8319d3bdf77 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:44.316556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1016/2056] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:44.317428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e361337-4efe-4b6e-8899-beef5c29e259 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:44.318907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7e361337-4efe-4b6e-8899-beef5c29e259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:44.403282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e361337-4efe-4b6e-8899-beef5c29e259 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:44.411008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1041/2057] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:44 2022] PUT /identity/v3/projects/9385533778214db4a511b47689beccff/users/f9e40888ea7c4ac0b023a0e2ea756348/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:44.415520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1374-acc4-4929-823e-b8319d3bdf77 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:44.472016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff9851-cbdd-4c09-ad06-50a34723d0d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:44.472633 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9851-cbdd-4c09-ad06-50a34723d0d4 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.472918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9851-cbdd-4c09-ad06-50a34723d0d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.473472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9851-cbdd-4c09-ad06-50a34723d0d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.493163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1374-acc4-4929-823e-b8319d3bdf77 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:44.498634 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b8d3f-0edd-4c8e-9957-a1ee7d722231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:44.499621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8d3f-0edd-4c8e-9957-a1ee7d722231 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.499981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8d3f-0edd-4c8e-9957-a1ee7d722231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.500333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8d3f-0edd-4c8e-9957-a1ee7d722231 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.501064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b8d3f-0edd-4c8e-9957-a1ee7d722231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:44.502809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b8d3f-0edd-4c8e-9957-a1ee7d722231 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:44.516535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1042/2058] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:44.520355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b8d3f-0edd-4c8e-9957-a1ee7d722231 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:44.532270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b8d3f-0edd-4c8e-9957-a1ee7d722231 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:44.537288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175861d9-db8d-4257-8d8b-7f34bdab2cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:44.537950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175861d9-db8d-4257-8d8b-7f34bdab2cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.538226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175861d9-db8d-4257-8d8b-7f34bdab2cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.538506 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175861d9-db8d-4257-8d8b-7f34bdab2cc5 admin admin] PATH_INFO: `/v3/projects/9385533778214db4a511b47689beccff/users/f9e40888ea7c4ac0b023a0e2ea756348/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.540572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175861d9-db8d-4257-8d8b-7f34bdab2cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9385533778214db4a511b47689beccff, user_id=f9e40888ea7c4ac0b023a0e2ea756348, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:44.541884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff9851-cbdd-4c09-ad06-50a34723d0d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:44.543080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175861d9-db8d-4257-8d8b-7f34bdab2cc5 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:44.543505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff9851-cbdd-4c09-ad06-50a34723d0d4 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:44.553181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1017/2059] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:44.554393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1043/2060] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:44 2022] PUT /identity/v3/projects/9385533778214db4a511b47689beccff/users/f9e40888ea7c4ac0b023a0e2ea756348/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:44.566048 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a36f8-b70d-4ff3-bb08-05b26498ca9d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.566339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a36f8-b70d-4ff3-bb08-05b26498ca9d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.566615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a36f8-b70d-4ff3-bb08-05b26498ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.596655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-188a36f8-b70d-4ff3-bb08-05b26498ca9d None None] MFA Rules not processed for user `f9e40888ea7c4ac0b023a0e2ea756348`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:44.598010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-188a36f8-b70d-4ff3-bb08-05b26498ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:44.690180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1018/2061] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:44.703490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175861d9-db8d-4257-8d8b-7f34bdab2cc5 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:44.771650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175861d9-db8d-4257-8d8b-7f34bdab2cc5 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:44.775226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07545d28-d5db-44f0-bf3c-58d12e157599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:44.775911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07545d28-d5db-44f0-bf3c-58d12e157599 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.776205 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07545d28-d5db-44f0-bf3c-58d12e157599 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.776460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07545d28-d5db-44f0-bf3c-58d12e157599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.788173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07545d28-d5db-44f0-bf3c-58d12e157599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:44.789941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07545d28-d5db-44f0-bf3c-58d12e157599 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:44.799458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1044/2062] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:45.088804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:45.158992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:45.632269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eb55e-70b2-47d8-b80c-b443e2c619a6 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:45.632754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eb55e-70b2-47d8-b80c-b443e2c619a6 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:45.632832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eb55e-70b2-47d8-b80c-b443e2c619a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:45.679992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ce8eb55e-70b2-47d8-b80c-b443e2c619a6 None None] MFA Rules not processed for user `c51868a65e084f738b380535f315030f`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:45.684206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ce8eb55e-70b2-47d8-b80c-b443e2c619a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:45.778894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1019/2063] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:45.846928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07545d28-d5db-44f0-bf3c-58d12e157599 service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:45.856752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07545d28-d5db-44f0-bf3c-58d12e157599 service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:45.860400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1a11c-02c3-49ec-8b12-08305b0bb09e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:45.861001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a11c-02c3-49ec-8b12-08305b0bb09e service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:45.861283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a11c-02c3-49ec-8b12-08305b0bb09e service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:45.861560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a11c-02c3-49ec-8b12-08305b0bb09e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:45.870735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1a11c-02c3-49ec-8b12-08305b0bb09e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:45.872195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1a11c-02c3-49ec-8b12-08305b0bb09e service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:45.881498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1045/2064] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:45.900187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:45.999419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eb55e-70b2-47d8-b80c-b443e2c619a6 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:46.001029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ce8eb55e-70b2-47d8-b80c-b443e2c619a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:46.081504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eb55e-70b2-47d8-b80c-b443e2c619a6 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:46.087215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:46.087885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.088175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.088448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] PATH_INFO: `/v3/users/5148ab0cf7a34b2c822a5d6eb896e7ed` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.089570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5148ab0cf7a34b2c822a5d6eb896e7ed)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:46.091546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:46.105216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:46.302136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5148ab0cf7a34b2c822a5d6eb896e7ed'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.302788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5148ab0cf7a34b2c822a5d6eb896e7ed'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.303442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5148ab0cf7a34b2c822a5d6eb896e7ed'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.316506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5148ab0cf7a34b2c822a5d6eb896e7ed'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.390917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5148ab0cf7a34b2c822a5d6eb896e7ed'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.404768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1020/2065] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:45 2022] DELETE /identity/v3/users/5148ab0cf7a34b2c822a5d6eb896e7ed => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:46.409133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5478-2226-49b3-920c-f5ed01c4f16d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.409648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5478-2226-49b3-920c-f5ed01c4f16d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.409730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5478-2226-49b3-920c-f5ed01c4f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.428225 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-abec5478-2226-49b3-920c-f5ed01c4f16d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:46.429421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-abec5478-2226-49b3-920c-f5ed01c4f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:46.494263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1046/2066] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:46.504488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:46.507926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:46.579491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e365a-8990-401d-a58a-040915c995d4 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:46.582794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebe53a-8a36-430f-81a5-8e6f549a4a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:46.583772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe53a-8a36-430f-81a5-8e6f549a4a0d service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.584068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe53a-8a36-430f-81a5-8e6f549a4a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.584336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe53a-8a36-430f-81a5-8e6f549a4a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.602361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebe53a-8a36-430f-81a5-8e6f549a4a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:46.605823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebe53a-8a36-430f-81a5-8e6f549a4a0d service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:46.608450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec5478-2226-49b3-920c-f5ed01c4f16d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:46.610128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-abec5478-2226-49b3-920c-f5ed01c4f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:46.621784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1021/2067] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:46.623256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec5478-2226-49b3-920c-f5ed01c4f16d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:46.633533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:46.638298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.638298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.638298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] PATH_INFO: `/v3/users/9ff13ca197744158b14abd7ea51680ea` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.638298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff13ca197744158b14abd7ea51680ea)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:46.639125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:46.808772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff13ca197744158b14abd7ea51680ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.809389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff13ca197744158b14abd7ea51680ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.810040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff13ca197744158b14abd7ea51680ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.854471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:46.912045 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff13ca197744158b14abd7ea51680ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.925792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff13ca197744158b14abd7ea51680ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:46.941383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1047/2068] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:46 2022] DELETE /identity/v3/users/9ff13ca197744158b14abd7ea51680ea => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:46.946166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7a626-afa9-423b-afbf-8a3ebf2d0855 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.946650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7a626-afa9-423b-afbf-8a3ebf2d0855 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.946766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7a626-afa9-423b-afbf-8a3ebf2d0855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.966222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-34a7a626-afa9-423b-afbf-8a3ebf2d0855 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:46.967469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-34a7a626-afa9-423b-afbf-8a3ebf2d0855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:47.031897 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:47.041045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1022/2069] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:47.052490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:47.054167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:47.134258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00aa14-378d-4efb-8960-1adf9d61827b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:47.138247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ef58b-7b91-44f8-9118-dd368389376b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:47.138877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ef58b-7b91-44f8-9118-dd368389376b service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:47.139163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ef58b-7b91-44f8-9118-dd368389376b service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:47.139463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ef58b-7b91-44f8-9118-dd368389376b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:47.149958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ef58b-7b91-44f8-9118-dd368389376b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:47.152069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ef58b-7b91-44f8-9118-dd368389376b service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:47.164149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1048/2070] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:47.478192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7a626-afa9-423b-afbf-8a3ebf2d0855 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:47.479310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-34a7a626-afa9-423b-afbf-8a3ebf2d0855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:47.493417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7a626-afa9-423b-afbf-8a3ebf2d0855 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:47.498438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:47.499326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:47.499804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:47.505835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] PATH_INFO: `/v3/projects/29a9c962065549928ac5660fcc549926` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:47.505835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a9c962065549928ac5660fcc549926)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:47.505835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:47.679119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a9c962065549928ac5660fcc549926', 'request_id': 'req-127057a1-2049-4fb9-9d5a-bd275a47b86a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:47.727192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dccc6-9ef4-43ea-acf4-89da53fc3295 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:47.727728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dccc6-9ef4-43ea-acf4-89da53fc3295 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:47.727846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dccc6-9ef4-43ea-acf4-89da53fc3295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:47.748618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-107dccc6-9ef4-43ea-acf4-89da53fc3295 None None] MFA Rules not processed for user `c51868a65e084f738b380535f315030f`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:47.750697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-107dccc6-9ef4-43ea-acf4-89da53fc3295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:47.792571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a9c962065549928ac5660fcc549926', 'request_id': 'req-127057a1-2049-4fb9-9d5a-bd275a47b86a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:47.803431 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a9c962065549928ac5660fcc549926', 'request_id': 'req-127057a1-2049-4fb9-9d5a-bd275a47b86a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:47.815244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] The token cache is being invalidate because project 29a9c962065549928ac5660fcc549926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:47.815612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:47.816198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:47.818435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1023/2071] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:47 2022] DELETE /identity/v3/projects/29a9c962065549928ac5660fcc549926 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:47.818978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1049/2072] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:47.822352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:47.829302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:47.894970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127057a1-2049-4fb9-9d5a-bd275a47b86a admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:47.900602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:47.901248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:47.901525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:47.901797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] PATH_INFO: `/v3/users/0553c12e685749458dcd1247c2462fd7` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:47.902935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0553c12e685749458dcd1247c2462fd7)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:47.904363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dccc6-9ef4-43ea-acf4-89da53fc3295 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:47.905049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:47.906100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-107dccc6-9ef4-43ea-acf4-89da53fc3295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:47.937675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dccc6-9ef4-43ea-acf4-89da53fc3295 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:47.950259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:47.950259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:47.950259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:47.950259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] PATH_INFO: `/v3/projects/2f785379f88247418a8bacbf423122b5` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:47.950706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f785379f88247418a8bacbf423122b5)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:47.950706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:48.002906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:48.143333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0553c12e685749458dcd1247c2462fd7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.144439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0553c12e685749458dcd1247c2462fd7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.145172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0553c12e685749458dcd1247c2462fd7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.152553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f785379f88247418a8bacbf423122b5', 'request_id': 'req-c8113cce-0306-40d3-8f5a-c490a84eec36'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.160260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f785379f88247418a8bacbf423122b5', 'request_id': 'req-c8113cce-0306-40d3-8f5a-c490a84eec36'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.162317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0553c12e685749458dcd1247c2462fd7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.209224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:48.242775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f785379f88247418a8bacbf423122b5', 'request_id': 'req-c8113cce-0306-40d3-8f5a-c490a84eec36'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.261230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] The token cache is being invalidate because project 2f785379f88247418a8bacbf423122b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:48.261521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.262246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.263883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1050/2073] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:47 2022] DELETE /identity/v3/projects/2f785379f88247418a8bacbf423122b5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:48.264851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:48.266202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:48.322322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0553c12e685749458dcd1247c2462fd7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.343388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8113cce-0306-40d3-8f5a-c490a84eec36 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:48.352611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:48.353287 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:48.359766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:48.359766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] PATH_INFO: `/v3/users/ca0e2f681c3c4e099ec9fd5621342bfe` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:48.359766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0e2f681c3c4e099ec9fd5621342bfe)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:48.359766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:48.362187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1024/2074] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:47 2022] DELETE /identity/v3/users/0553c12e685749458dcd1247c2462fd7 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:48.362187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:48.365519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:48.443846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03e59d-8ad6-40f4-93b7-993bfa522c94 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:48.447783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:48.448512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:48.448763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:48.449035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:48.452928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:48.538571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:48.540400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:48.557660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1025/2075] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:48.558369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:48.559781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:48.607242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0e2f681c3c4e099ec9fd5621342bfe'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.607949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0e2f681c3c4e099ec9fd5621342bfe'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.608659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0e2f681c3c4e099ec9fd5621342bfe'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.646702 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce923a3-dc81-47b7-9bbc-b6f58eb6dac1 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:48.653371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:48.654743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:48.655052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:48.655378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] PATH_INFO: `/v3/users/f9e40888ea7c4ac0b023a0e2ea756348` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:48.656588 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e40888ea7c4ac0b023a0e2ea756348)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:48.658873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:48.682850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0e2f681c3c4e099ec9fd5621342bfe'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.706534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4177567f-0d13-4f67-bab5-d41a38dff1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0e2f681c3c4e099ec9fd5621342bfe'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.731758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1051/2076] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:48 2022] DELETE /identity/v3/users/ca0e2f681c3c4e099ec9fd5621342bfe => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:48.737758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b83b3-e22a-409d-8e27-f21edbc073ea None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:48.737758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b83b3-e22a-409d-8e27-f21edbc073ea None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:48.737758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b83b3-e22a-409d-8e27-f21edbc073ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:48.757926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-565b83b3-e22a-409d-8e27-f21edbc073ea None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:48.759156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-565b83b3-e22a-409d-8e27-f21edbc073ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:48.843943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1052/2077] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:48.857630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b83b3-e22a-409d-8e27-f21edbc073ea None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:48.859168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-565b83b3-e22a-409d-8e27-f21edbc073ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:48.878380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e40888ea7c4ac0b023a0e2ea756348'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.879158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e40888ea7c4ac0b023a0e2ea756348'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.880075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e40888ea7c4ac0b023a0e2ea756348'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.905261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e40888ea7c4ac0b023a0e2ea756348'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.945011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b83b3-e22a-409d-8e27-f21edbc073ea None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:48.952726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:48.954202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:48.954777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:48.955157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:48.957483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:48.973704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b655893a-3e1d-449d-b0f9-6f4c144b13e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e40888ea7c4ac0b023a0e2ea756348'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:48.984683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:48.984683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:48.999360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1053/2078] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:49.001591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:49.003933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:49.014718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1026/2079] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:48 2022] DELETE /identity/v3/users/f9e40888ea7c4ac0b023a0e2ea756348 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:49.023130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7aba-9dc9-4602-81bb-8303c063de07 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:49.088699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:49.113564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:49.114525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:49.115005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:49.116164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] PATH_INFO: `/v3/projects/f2360b2099584a71a20f8599a705c43b` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:49.118724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2360b2099584a71a20f8599a705c43b)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:49.121577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:49.269434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2360b2099584a71a20f8599a705c43b', 'request_id': 'req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:49.283781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2360b2099584a71a20f8599a705c43b', 'request_id': 'req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:49.380617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2360b2099584a71a20f8599a705c43b', 'request_id': 'req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:49.400551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] The token cache is being invalidate because project f2360b2099584a71a20f8599a705c43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:49.400792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:49.402103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7e779f8d-3735-4e8b-b1b1-eaf6d24a0412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:49.404121 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1054/2080] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:48 2022] DELETE /identity/v3/projects/f2360b2099584a71a20f8599a705c43b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:49.409201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238bb70-589e-4027-b6eb-b20e60eb942d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:49.409766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238bb70-589e-4027-b6eb-b20e60eb942d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:49.409766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238bb70-589e-4027-b6eb-b20e60eb942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:49.444096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3238bb70-589e-4027-b6eb-b20e60eb942d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:49.447505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3238bb70-589e-4027-b6eb-b20e60eb942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:49.556311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1027/2081] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:49.714481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3e67-b921-460c-99ae-5fb104627238 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:49.715179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3e67-b921-460c-99ae-5fb104627238 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:49.715672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3e67-b921-460c-99ae-5fb104627238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:49.736987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-761d3e67-b921-460c-99ae-5fb104627238 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:49.738787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-761d3e67-b921-460c-99ae-5fb104627238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:49.768528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1055/2082] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:49.779928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238bb70-589e-4027-b6eb-b20e60eb942d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:49.791066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238bb70-589e-4027-b6eb-b20e60eb942d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:49.797583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:49.798218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:49.798713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:49.799029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:49.799870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:49.800245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:49.811659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:49.824076 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1028/2083] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:49.825445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d3e67-b921-460c-99ae-5fb104627238 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:49.837030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d3e67-b921-460c-99ae-5fb104627238 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:49.842224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f831-e325-4442-92d8-396ed6f8409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:49.842841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f831-e325-4442-92d8-396ed6f8409f admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:49.843151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f831-e325-4442-92d8-396ed6f8409f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:49.843470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34f831-e325-4442-92d8-396ed6f8409f admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:49.844137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f831-e325-4442-92d8-396ed6f8409f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:49.846041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34f831-e325-4442-92d8-396ed6f8409f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:50.295384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:50.297401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:50.310784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76827118-1486-4245-a4b2-6b8795053e41 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:50.316170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:50.316847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:50.317204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:50.317480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] PATH_INFO: `/v3/projects/f30efeaed8104b02acce6c3b86ece58e` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:50.318724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30efeaed8104b02acce6c3b86ece58e)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:50.320744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:50.351576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:50.441047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1056/2084] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:49 2022] POST /identity/v3/projects => generated 373 bytes in 616 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:50.441896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f831-e325-4442-92d8-396ed6f8409f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:50.444932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2c34f831-e325-4442-92d8-396ed6f8409f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:50.501333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30efeaed8104b02acce6c3b86ece58e', 'request_id': 'req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.519343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34f831-e325-4442-92d8-396ed6f8409f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:50.586325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:50.586956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:50.587236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:50.587539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] PATH_INFO: `/v3/projects/9385533778214db4a511b47689beccff` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:50.588654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9385533778214db4a511b47689beccff)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:50.590569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:50.602041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30efeaed8104b02acce6c3b86ece58e', 'request_id': 'req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.609530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30efeaed8104b02acce6c3b86ece58e', 'request_id': 'req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.620860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] The token cache is being invalidate because project f30efeaed8104b02acce6c3b86ece58e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:50.621152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.621812 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.623339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1029/2085] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:50 2022] DELETE /identity/v3/projects/f30efeaed8104b02acce6c3b86ece58e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:50.624131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:50.625426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:50.638954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9516e-cc34-4eec-8eb9-0a41dab9f7ff admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:50.643955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609f28a-a8c1-4493-bbc0-a69b5b8a7870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:50.644552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609f28a-a8c1-4493-bbc0-a69b5b8a7870 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:50.644834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609f28a-a8c1-4493-bbc0-a69b5b8a7870 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:50.645110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609f28a-a8c1-4493-bbc0-a69b5b8a7870 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:50.645868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609f28a-a8c1-4493-bbc0-a69b5b8a7870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:50.647909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609f28a-a8c1-4493-bbc0-a69b5b8a7870 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:50.698669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9385533778214db4a511b47689beccff', 'request_id': 'req-b44b1288-bd18-422f-9e60-2b8e4cda4f41'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.704934 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9385533778214db4a511b47689beccff', 'request_id': 'req-b44b1288-bd18-422f-9e60-2b8e4cda4f41'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.739794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:50.855100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1030/2086] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:50 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:50.856022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609f28a-a8c1-4493-bbc0-a69b5b8a7870 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:50.857636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0609f28a-a8c1-4493-bbc0-a69b5b8a7870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:50.871579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9385533778214db4a511b47689beccff', 'request_id': 'req-b44b1288-bd18-422f-9e60-2b8e4cda4f41'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.872909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609f28a-a8c1-4493-bbc0-a69b5b8a7870 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:50.885076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] The token cache is being invalidate because project 9385533778214db4a511b47689beccff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:50.885383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.886018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:50.887979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1057/2087] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:50 2022] DELETE /identity/v3/projects/9385533778214db4a511b47689beccff => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:50.891436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:50.891436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:50.946500 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:50.947283 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:50.947592 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:50.947874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] PATH_INFO: `/v3/users/8a2f878bd31446d98a3821c2830b6dbc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:50.949622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2f878bd31446d98a3821c2830b6dbc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:50.951270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:50.985398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b1288-bd18-422f-9e60-2b8e4cda4f41 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:50.990915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63311570-9d3c-43ca-bd44-e22aa119aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:50.991548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63311570-9d3c-43ca-bd44-e22aa119aa7b admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:50.991855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63311570-9d3c-43ca-bd44-e22aa119aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:50.992126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63311570-9d3c-43ca-bd44-e22aa119aa7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:50.992765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63311570-9d3c-43ca-bd44-e22aa119aa7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:50.994380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63311570-9d3c-43ca-bd44-e22aa119aa7b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.004539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1058/2088] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:51.005907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66515990-708d-479b-a27a-9f15622ebbdc None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.006192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66515990-708d-479b-a27a-9f15622ebbdc None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.006468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66515990-708d-479b-a27a-9f15622ebbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.025883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-66515990-708d-479b-a27a-9f15622ebbdc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:51.027127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-66515990-708d-479b-a27a-9f15622ebbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:51.035086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1059/2089] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:51.036433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66515990-708d-479b-a27a-9f15622ebbdc None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:51.047442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66515990-708d-479b-a27a-9f15622ebbdc None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:51.056138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bce30-856d-4b0e-840b-60fc438932fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:51.056844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bce30-856d-4b0e-840b-60fc438932fd admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.059208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bce30-856d-4b0e-840b-60fc438932fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.062049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bce30-856d-4b0e-840b-60fc438932fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.062049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bce30-856d-4b0e-840b-60fc438932fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:51.062912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bce30-856d-4b0e-840b-60fc438932fd admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.073588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1060/2090] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:51.074957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51406-fb1f-454f-89ae-f0e9bb1f73de None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.075242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51406-fb1f-454f-89ae-f0e9bb1f73de None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.075532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51406-fb1f-454f-89ae-f0e9bb1f73de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.096680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-99d51406-fb1f-454f-89ae-f0e9bb1f73de None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:51.097874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-99d51406-fb1f-454f-89ae-f0e9bb1f73de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:51.112031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1061/2091] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:51.112031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51406-fb1f-454f-89ae-f0e9bb1f73de None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:51.119911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51406-fb1f-454f-89ae-f0e9bb1f73de None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:51.124467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a40420-ea1b-449a-b597-bccbaf10554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:51.125109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a40420-ea1b-449a-b597-bccbaf10554b admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.125388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a40420-ea1b-449a-b597-bccbaf10554b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.125666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a40420-ea1b-449a-b597-bccbaf10554b admin admin] PATH_INFO: `/v3/projects/1eb1b0c1ea564a5c9ea4398c523f016e/users/9d544d38a5664f68bff83e6c9798ffd9/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.151429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a40420-ea1b-449a-b597-bccbaf10554b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb1b0c1ea564a5c9ea4398c523f016e, user_id=9d544d38a5664f68bff83e6c9798ffd9, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:51.151429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a40420-ea1b-449a-b597-bccbaf10554b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.182261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2f878bd31446d98a3821c2830b6dbc'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:51.183031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2f878bd31446d98a3821c2830b6dbc'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:51.183675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2f878bd31446d98a3821c2830b6dbc'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:51.196275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2f878bd31446d98a3821c2830b6dbc'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:51.283139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1062/2092] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:51 2022] PUT /identity/v3/projects/1eb1b0c1ea564a5c9ea4398c523f016e/users/9d544d38a5664f68bff83e6c9798ffd9/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:51.284431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a40420-ea1b-449a-b597-bccbaf10554b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:51.285963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-79a40420-ea1b-449a-b597-bccbaf10554b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:51.299546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6c9422ff-d5cb-4eae-8310-656e204363e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2f878bd31446d98a3821c2830b6dbc'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:51.314135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1031/2093] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:50 2022] DELETE /identity/v3/users/8a2f878bd31446d98a3821c2830b6dbc => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:51.318449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8da08f-ca9c-43ee-aab4-e7f81f77c9fd None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.318449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8da08f-ca9c-43ee-aab4-e7f81f77c9fd None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.318449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8da08f-ca9c-43ee-aab4-e7f81f77c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.340868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-4d8da08f-ca9c-43ee-aab4-e7f81f77c9fd None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:51.340868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4d8da08f-ca9c-43ee-aab4-e7f81f77c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:51.360436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a40420-ea1b-449a-b597-bccbaf10554b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:51.409637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1032/2094] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:51.422442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8da08f-ca9c-43ee-aab4-e7f81f77c9fd None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:51.424361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4d8da08f-ca9c-43ee-aab4-e7f81f77c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:51.433724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d200e-0e4d-4cf9-802f-30e063839e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:51.434417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d200e-0e4d-4cf9-802f-30e063839e33 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.434749 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d200e-0e4d-4cf9-802f-30e063839e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.435040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d200e-0e4d-4cf9-802f-30e063839e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.435794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d200e-0e4d-4cf9-802f-30e063839e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:51.436436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d200e-0e4d-4cf9-802f-30e063839e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:51.440938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d200e-0e4d-4cf9-802f-30e063839e33 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.458163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1063/2095] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:51.462531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d200e-0e4d-4cf9-802f-30e063839e33 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:51.473141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d200e-0e4d-4cf9-802f-30e063839e33 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:51.479332 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b6ef-c830-4cde-a562-c2a0f9f0fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:51.479974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b6ef-c830-4cde-a562-c2a0f9f0fd36 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.480259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b6ef-c830-4cde-a562-c2a0f9f0fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.480538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b6ef-c830-4cde-a562-c2a0f9f0fd36 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.481195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067b6ef-c830-4cde-a562-c2a0f9f0fd36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:51.483144 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067b6ef-c830-4cde-a562-c2a0f9f0fd36 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.492772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8da08f-ca9c-43ee-aab4-e7f81f77c9fd None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:51.496790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02534f8-236f-459c-829a-91eafcc82053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:51.497471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02534f8-236f-459c-829a-91eafcc82053 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.497954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02534f8-236f-459c-829a-91eafcc82053 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.498200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02534f8-236f-459c-829a-91eafcc82053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.508193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02534f8-236f-459c-829a-91eafcc82053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:51.509798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02534f8-236f-459c-829a-91eafcc82053 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.519377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1033/2096] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:51.624433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1064/2097] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:51 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:51.628765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02534f8-236f-459c-829a-91eafcc82053 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:51.639918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02534f8-236f-459c-829a-91eafcc82053 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:51.702526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dab43f-04bd-499b-85f0-1fd0540fc411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:51.703220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dab43f-04bd-499b-85f0-1fd0540fc411 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.703537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dab43f-04bd-499b-85f0-1fd0540fc411 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.703895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dab43f-04bd-499b-85f0-1fd0540fc411 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.704480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dab43f-04bd-499b-85f0-1fd0540fc411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:51.706727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dab43f-04bd-499b-85f0-1fd0540fc411 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.856677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1034/2098] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:51 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:51.859101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b6ef-c830-4cde-a562-c2a0f9f0fd36 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:51.862128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f067b6ef-c830-4cde-a562-c2a0f9f0fd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:51.877331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dab43f-04bd-499b-85f0-1fd0540fc411 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:51.887264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b6ef-c830-4cde-a562-c2a0f9f0fd36 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:51.900157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:51.900804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.901081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.901346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] PATH_INFO: `/v3/projects/d7264694b48b442b8765d7fcca0af470` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.902469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7264694b48b442b8765d7fcca0af470)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:51.904438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.911932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dab43f-04bd-499b-85f0-1fd0540fc411 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:51.919359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672109ed-56de-4982-ae25-98f68fb6e978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:51.923640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672109ed-56de-4982-ae25-98f68fb6e978 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.923640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672109ed-56de-4982-ae25-98f68fb6e978 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.923640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672109ed-56de-4982-ae25-98f68fb6e978 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.925229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672109ed-56de-4982-ae25-98f68fb6e978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:51.927533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672109ed-56de-4982-ae25-98f68fb6e978 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.942054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1035/2099] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:51.945754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672109ed-56de-4982-ae25-98f68fb6e978 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:51.958585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:51.962525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672109ed-56de-4982-ae25-98f68fb6e978 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:51.977226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1a5bc-e772-4692-8784-4aba076aa441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:51.978045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1a5bc-e772-4692-8784-4aba076aa441 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:51.978466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1a5bc-e772-4692-8784-4aba076aa441 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:51.978838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1a5bc-e772-4692-8784-4aba076aa441 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:51.979998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1a5bc-e772-4692-8784-4aba076aa441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:51.982351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1a5bc-e772-4692-8784-4aba076aa441 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:51.998546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1036/2100] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:52.005615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1a5bc-e772-4692-8784-4aba076aa441 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:52.033320 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1a5bc-e772-4692-8784-4aba076aa441 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:52.040755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bc829-85ad-4e85-ae80-21c72003d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:52.041522 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bc829-85ad-4e85-ae80-21c72003d4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.041820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bc829-85ad-4e85-ae80-21c72003d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.042101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bc829-85ad-4e85-ae80-21c72003d4eb admin admin] PATH_INFO: `/v3/projects/3926897ae7b4463db655d89cb0a178af/users/b2fe7b0606234800b6358365aa89fac3/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.085675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bc829-85ad-4e85-ae80-21c72003d4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3926897ae7b4463db655d89cb0a178af, user_id=b2fe7b0606234800b6358365aa89fac3, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:52.089184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bc829-85ad-4e85-ae80-21c72003d4eb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:52.129441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7264694b48b442b8765d7fcca0af470', 'request_id': 'req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:52.141951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7264694b48b442b8765d7fcca0af470', 'request_id': 'req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:52.214791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1037/2101] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:52 2022] PUT /identity/v3/projects/3926897ae7b4463db655d89cb0a178af/users/b2fe7b0606234800b6358365aa89fac3/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:52.222879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7264694b48b442b8765d7fcca0af470', 'request_id': 'req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:52.226632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c538cf-ce19-4448-9e8e-863cf2208feb None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.227133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c538cf-ce19-4448-9e8e-863cf2208feb None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.227252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c538cf-ce19-4448-9e8e-863cf2208feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.252050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] The token cache is being invalidate because project d7264694b48b442b8765d7fcca0af470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:52.252357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:52.253601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8042e4dd-dce2-40a7-bc4f-5bda452a0a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:52.267578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1065/2102] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:51 2022] DELETE /identity/v3/projects/d7264694b48b442b8765d7fcca0af470 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:52.269521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c4985-52e3-4351-a69b-020ebdf30705 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.270017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c4985-52e3-4351-a69b-020ebdf30705 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.270756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c4985-52e3-4351-a69b-020ebdf30705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.271886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:52.292125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c90c4985-52e3-4351-a69b-020ebdf30705 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:52.293852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c90c4985-52e3-4351-a69b-020ebdf30705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:52.294374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-28c538cf-ce19-4448-9e8e-863cf2208feb None None] MFA Rules not processed for user `b2fe7b0606234800b6358365aa89fac3`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:52.295658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-28c538cf-ce19-4448-9e8e-863cf2208feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:52.425173 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1038/2103] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:52.430988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1066/2104] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:52.434129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c538cf-ce19-4448-9e8e-863cf2208feb None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:52.440389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-28c538cf-ce19-4448-9e8e-863cf2208feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:52.441291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c08bc-543e-4d81-82aa-16a52975d073 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.441584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c08bc-543e-4d81-82aa-16a52975d073 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.441861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c08bc-543e-4d81-82aa-16a52975d073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.463815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f95c08bc-543e-4d81-82aa-16a52975d073 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:52.465048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f95c08bc-543e-4d81-82aa-16a52975d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:52.477887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c538cf-ce19-4448-9e8e-863cf2208feb None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:52.478642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1067/2105] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:52.479620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c08bc-543e-4d81-82aa-16a52975d073 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:52.486776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0716-7def-4cb3-bc1f-a39095219acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:52.491457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0716-7def-4cb3-bc1f-a39095219acc admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.491457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0716-7def-4cb3-bc1f-a39095219acc admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.491457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0716-7def-4cb3-bc1f-a39095219acc admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.491661 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c08bc-543e-4d81-82aa-16a52975d073 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:52.491737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d0716-7def-4cb3-bc1f-a39095219acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:52.493935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d0716-7def-4cb3-bc1f-a39095219acc admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:52.509746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19670f16-8a41-4f69-b579-09886139ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:52.510686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19670f16-8a41-4f69-b579-09886139ff03 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.511206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19670f16-8a41-4f69-b579-09886139ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.511703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19670f16-8a41-4f69-b579-09886139ff03 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.513288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19670f16-8a41-4f69-b579-09886139ff03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:52.513813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19670f16-8a41-4f69-b579-09886139ff03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:52.517395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19670f16-8a41-4f69-b579-09886139ff03 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:52.534368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1068/2106] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:52.540505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19670f16-8a41-4f69-b579-09886139ff03 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:52.551495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19670f16-8a41-4f69-b579-09886139ff03 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:52.558570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980097-ab3a-4282-b254-2f4070789510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:52.559264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980097-ab3a-4282-b254-2f4070789510 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.559677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980097-ab3a-4282-b254-2f4070789510 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.560275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980097-ab3a-4282-b254-2f4070789510 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.561080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980097-ab3a-4282-b254-2f4070789510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:52.563414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980097-ab3a-4282-b254-2f4070789510 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:52.600154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1039/2107] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:52 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:52.601104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0716-7def-4cb3-bc1f-a39095219acc admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:52.644236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1069/2108] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:52 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:52.649542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980097-ab3a-4282-b254-2f4070789510 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:52.688322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0716-7def-4cb3-bc1f-a39095219acc admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:52.783044 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abf6a-3dc6-4281-924c-92078019ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:52.784271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abf6a-3dc6-4281-924c-92078019ce9f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.784665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abf6a-3dc6-4281-924c-92078019ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.785169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260abf6a-3dc6-4281-924c-92078019ce9f admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.787584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260abf6a-3dc6-4281-924c-92078019ce9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:52.789996 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260abf6a-3dc6-4281-924c-92078019ce9f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:52.870882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980097-ab3a-4282-b254-2f4070789510 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:52.875864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64dfc-9b15-4a14-adca-69bdb45fab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:52.876564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64dfc-9b15-4a14-adca-69bdb45fab3f admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.876851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64dfc-9b15-4a14-adca-69bdb45fab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.877290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64dfc-9b15-4a14-adca-69bdb45fab3f admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.878021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f64dfc-9b15-4a14-adca-69bdb45fab3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:52.880641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f64dfc-9b15-4a14-adca-69bdb45fab3f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:52.923121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1040/2109] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:52 2022] POST /identity/v3/users => generated 296 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:52.924496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abf6a-3dc6-4281-924c-92078019ce9f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:52.935786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260abf6a-3dc6-4281-924c-92078019ce9f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:52.941527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7ee9-49e2-4372-a263-e46a8e675389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:52.942836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7ee9-49e2-4372-a263-e46a8e675389 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.943176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7ee9-49e2-4372-a263-e46a8e675389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.943523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7ee9-49e2-4372-a263-e46a8e675389 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.944249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7ee9-49e2-4372-a263-e46a8e675389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:52.945946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7ee9-49e2-4372-a263-e46a8e675389 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:52.956490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1041/2110] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:52.964285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7ee9-49e2-4372-a263-e46a8e675389 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:52.975439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7ee9-49e2-4372-a263-e46a8e675389 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:52.980478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a69ed0-4086-41b0-9800-b905fecabb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:52.984312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a69ed0-4086-41b0-9800-b905fecabb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.984312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a69ed0-4086-41b0-9800-b905fecabb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.984312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a69ed0-4086-41b0-9800-b905fecabb8b admin admin] PATH_INFO: `/v3/projects/c666bb8daa02402fa1c8f19aff35cddb/users/9c8f6658ca7f4fedad9669783a06e4a8/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.997837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a69ed0-4086-41b0-9800-b905fecabb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c666bb8daa02402fa1c8f19aff35cddb, user_id=9c8f6658ca7f4fedad9669783a06e4a8, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:53.000598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a69ed0-4086-41b0-9800-b905fecabb8b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:53.014082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1070/2111] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:52 2022] POST /identity/v3/users => generated 300 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:53.022628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64dfc-9b15-4a14-adca-69bdb45fab3f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:53.029475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64dfc-9b15-4a14-adca-69bdb45fab3f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:53.034995 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8914-149b-4bf3-beeb-798b2074a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:53.035927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8914-149b-4bf3-beeb-798b2074a100 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.036082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8914-149b-4bf3-beeb-798b2074a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.036346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c8914-149b-4bf3-beeb-798b2074a100 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.036999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c8914-149b-4bf3-beeb-798b2074a100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:53.038607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c8914-149b-4bf3-beeb-798b2074a100 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:53.049555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1071/2112] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:53.060078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8914-149b-4bf3-beeb-798b2074a100 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:53.071177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c8914-149b-4bf3-beeb-798b2074a100 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:53.075950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07310172-2a31-407f-96f2-3c35b46c6473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:53.076567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07310172-2a31-407f-96f2-3c35b46c6473 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.076844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07310172-2a31-407f-96f2-3c35b46c6473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.077112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07310172-2a31-407f-96f2-3c35b46c6473 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.077756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07310172-2a31-407f-96f2-3c35b46c6473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:53.079420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07310172-2a31-407f-96f2-3c35b46c6473 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:53.090541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1072/2113] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:53.094682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07310172-2a31-407f-96f2-3c35b46c6473 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:53.105424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07310172-2a31-407f-96f2-3c35b46c6473 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:53.110583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d887f-8fb7-479c-8cb1-74c6579a091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:53.111232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d887f-8fb7-479c-8cb1-74c6579a091f admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.111549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d887f-8fb7-479c-8cb1-74c6579a091f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.111824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d887f-8fb7-479c-8cb1-74c6579a091f admin admin] PATH_INFO: `/v3/projects/c476903a25a34c17899121f094b63d41/users/b0fe8ea26c5c4858ad699972a0ae38ea/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.119051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1042/2114] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:52 2022] PUT /identity/v3/projects/c666bb8daa02402fa1c8f19aff35cddb/users/9c8f6658ca7f4fedad9669783a06e4a8/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:53.127276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d887f-8fb7-479c-8cb1-74c6579a091f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c476903a25a34c17899121f094b63d41, user_id=b0fe8ea26c5c4858ad699972a0ae38ea, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:53.128800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a69ed0-4086-41b0-9800-b905fecabb8b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:53.130119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d887f-8fb7-479c-8cb1-74c6579a091f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:53.191531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a69ed0-4086-41b0-9800-b905fecabb8b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:53.197291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9762-f9b9-4285-ae98-2850db1eba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:53.197913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9762-f9b9-4285-ae98-2850db1eba5c admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.198191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9762-f9b9-4285-ae98-2850db1eba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.198471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9762-f9b9-4285-ae98-2850db1eba5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.199118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf9762-f9b9-4285-ae98-2850db1eba5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:53.200748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf9762-f9b9-4285-ae98-2850db1eba5c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:53.217869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1043/2115] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:53.226792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1073/2116] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:53 2022] PUT /identity/v3/projects/c476903a25a34c17899121f094b63d41/users/b0fe8ea26c5c4858ad699972a0ae38ea/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:53.226940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9762-f9b9-4285-ae98-2850db1eba5c admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:53.237812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abf29d-41b7-427e-ad88-96fa51e88b02 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.237812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abf29d-41b7-427e-ad88-96fa51e88b02 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.238067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abf29d-41b7-427e-ad88-96fa51e88b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.244822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9762-f9b9-4285-ae98-2850db1eba5c admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:53.310043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-89abf29d-41b7-427e-ad88-96fa51e88b02 None None] MFA Rules not processed for user `b0fe8ea26c5c4858ad699972a0ae38ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:53.311527 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-89abf29d-41b7-427e-ad88-96fa51e88b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:53.353767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e2763-5bcc-4813-be41-f89b4a8b9047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:53.354999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2763-5bcc-4813-be41-f89b4a8b9047 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.358102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2763-5bcc-4813-be41-f89b4a8b9047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.358102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2763-5bcc-4813-be41-f89b4a8b9047 admin admin] PATH_INFO: `/v3/projects/c666bb8daa02402fa1c8f19aff35cddb/users/9c8f6658ca7f4fedad9669783a06e4a8/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.371589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e2763-5bcc-4813-be41-f89b4a8b9047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c666bb8daa02402fa1c8f19aff35cddb, user_id=9c8f6658ca7f4fedad9669783a06e4a8, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:53.374742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e2763-5bcc-4813-be41-f89b4a8b9047 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:53.394204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1044/2117] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:53 2022] PUT /identity/v3/projects/c666bb8daa02402fa1c8f19aff35cddb/users/9c8f6658ca7f4fedad9669783a06e4a8/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:53.403086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71d67-bb2a-4836-b00f-a6e2d4af59c8 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.409247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71d67-bb2a-4836-b00f-a6e2d4af59c8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.413786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71d67-bb2a-4836-b00f-a6e2d4af59c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.433544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:53.467612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1074/2118] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:53.467612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c86992-6cd2-4667-a445-bbb602d3a4b1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.467612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c86992-6cd2-4667-a445-bbb602d3a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.467612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c86992-6cd2-4667-a445-bbb602d3a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.526334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f8c86992-6cd2-4667-a445-bbb602d3a4b1 None None] MFA Rules not processed for user `9c8f6658ca7f4fedad9669783a06e4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:53.528056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f8c86992-6cd2-4667-a445-bbb602d3a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:53.532326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-9bc71d67-bb2a-4836-b00f-a6e2d4af59c8 None None] MFA Rules not processed for user `9d544d38a5664f68bff83e6c9798ffd9`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:53.535501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9bc71d67-bb2a-4836-b00f-a6e2d4af59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:53.619201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:53.678203 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1075/2119] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:53.679227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c86992-6cd2-4667-a445-bbb602d3a4b1 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:53.688367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1045/2120] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:53.690922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc71d67-bb2a-4836-b00f-a6e2d4af59c8 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:53.693560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9bc71d67-bb2a-4836-b00f-a6e2d4af59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:53.779611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c86992-6cd2-4667-a445-bbb602d3a4b1 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:53.784607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424314ac-31ea-4a73-8b7f-642c20780a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:53.785298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424314ac-31ea-4a73-8b7f-642c20780a8f admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.786471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424314ac-31ea-4a73-8b7f-642c20780a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.786875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424314ac-31ea-4a73-8b7f-642c20780a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.787837 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424314ac-31ea-4a73-8b7f-642c20780a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:53.793342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424314ac-31ea-4a73-8b7f-642c20780a8f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:53.804542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc71d67-bb2a-4836-b00f-a6e2d4af59c8 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:53.812508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e578d-b8ab-43e5-bcb9-41e1321afbc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:53.813409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e578d-b8ab-43e5-bcb9-41e1321afbc8 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.813857 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e578d-b8ab-43e5-bcb9-41e1321afbc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.814116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e578d-b8ab-43e5-bcb9-41e1321afbc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.825028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e578d-b8ab-43e5-bcb9-41e1321afbc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:53.826471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e578d-b8ab-43e5-bcb9-41e1321afbc8 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:53.839432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1046/2121] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:53.919675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1076/2122] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:53 2022] POST /identity/v3/projects => generated 399 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:53.923553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e578d-b8ab-43e5-bcb9-41e1321afbc8 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:53.935709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e578d-b8ab-43e5-bcb9-41e1321afbc8 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:54.007722 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424314ac-31ea-4a73-8b7f-642c20780a8f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:54.042695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95a1c6-523f-4b5c-a624-4468bc9a6615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:54.045140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95a1c6-523f-4b5c-a624-4468bc9a6615 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.045475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95a1c6-523f-4b5c-a624-4468bc9a6615 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.045751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95a1c6-523f-4b5c-a624-4468bc9a6615 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.047568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95a1c6-523f-4b5c-a624-4468bc9a6615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:54.049866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95a1c6-523f-4b5c-a624-4468bc9a6615 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:54.114698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424314ac-31ea-4a73-8b7f-642c20780a8f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:54.119051 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222a6c-844b-46f3-bd28-dc3c217d2f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:54.119712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222a6c-844b-46f3-bd28-dc3c217d2f65 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.119999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222a6c-844b-46f3-bd28-dc3c217d2f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.120274 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222a6c-844b-46f3-bd28-dc3c217d2f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.144008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1047/2123] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:53 2022] POST /identity/v3/users => generated 306 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:54.153948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95a1c6-523f-4b5c-a624-4468bc9a6615 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:54.170451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95a1c6-523f-4b5c-a624-4468bc9a6615 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:54.177751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94683243-2976-424a-b20a-1a2c4590bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:54.178524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683243-2976-424a-b20a-1a2c4590bf5c admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.186880 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683243-2976-424a-b20a-1a2c4590bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.186880 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94683243-2976-424a-b20a-1a2c4590bf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.186880 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94683243-2976-424a-b20a-1a2c4590bf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:54.186880 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94683243-2976-424a-b20a-1a2c4590bf5c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:54.197123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1048/2124] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:54.199523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94683243-2976-424a-b20a-1a2c4590bf5c admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:54.232862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94683243-2976-424a-b20a-1a2c4590bf5c admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:54.240851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454621e5-4517-4341-a1cb-ff2a84837c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:54.242429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454621e5-4517-4341-a1cb-ff2a84837c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.242879 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454621e5-4517-4341-a1cb-ff2a84837c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.243363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454621e5-4517-4341-a1cb-ff2a84837c1e admin admin] PATH_INFO: `/v3/projects/2091224650c8426d9faf27f1dedf0f01/users/8ba6404fa2614d3bb7fdcd166c98ea0a/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.248868 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e222a6c-844b-46f3-bd28-dc3c217d2f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:54.251765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e222a6c-844b-46f3-bd28-dc3c217d2f65 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:54.267543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454621e5-4517-4341-a1cb-ff2a84837c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2091224650c8426d9faf27f1dedf0f01, user_id=8ba6404fa2614d3bb7fdcd166c98ea0a, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:54.272020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454621e5-4517-4341-a1cb-ff2a84837c1e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:54.280157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1077/2125] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:54.430157 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1049/2126] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:54 2022] PUT /identity/v3/projects/2091224650c8426d9faf27f1dedf0f01/users/8ba6404fa2614d3bb7fdcd166c98ea0a/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:54.430652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222a6c-844b-46f3-bd28-dc3c217d2f65 service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:54.430652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222a6c-844b-46f3-bd28-dc3c217d2f65 service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:54.476626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d150a9-bce8-4786-bcd7-9e1c6047605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:54.481717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d150a9-bce8-4786-bcd7-9e1c6047605a admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.481717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d150a9-bce8-4786-bcd7-9e1c6047605a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.481717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d150a9-bce8-4786-bcd7-9e1c6047605a admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.481717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d150a9-bce8-4786-bcd7-9e1c6047605a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:54.481717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d150a9-bce8-4786-bcd7-9e1c6047605a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:54.497144 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1078/2127] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:54.500444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454621e5-4517-4341-a1cb-ff2a84837c1e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:54.511891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454621e5-4517-4341-a1cb-ff2a84837c1e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:54.517332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243690d-326e-46a4-95ca-37bb6c2573ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:54.517998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243690d-326e-46a4-95ca-37bb6c2573ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.518307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243690d-326e-46a4-95ca-37bb6c2573ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.518585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243690d-326e-46a4-95ca-37bb6c2573ef admin admin] PATH_INFO: `/v3/projects/2091224650c8426d9faf27f1dedf0f01/users/8ba6404fa2614d3bb7fdcd166c98ea0a/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.520768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243690d-326e-46a4-95ca-37bb6c2573ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2091224650c8426d9faf27f1dedf0f01, user_id=8ba6404fa2614d3bb7fdcd166c98ea0a, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:54.527035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243690d-326e-46a4-95ca-37bb6c2573ef admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:54.545275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1050/2128] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:54 2022] PUT /identity/v3/projects/2091224650c8426d9faf27f1dedf0f01/users/8ba6404fa2614d3bb7fdcd166c98ea0a/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:54.550718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd0b98-11d5-48c5-9c3c-16ea207b4b3a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.550718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd0b98-11d5-48c5-9c3c-16ea207b4b3a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.550718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd0b98-11d5-48c5-9c3c-16ea207b4b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.583699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8bfd0b98-11d5-48c5-9c3c-16ea207b4b3a None None] MFA Rules not processed for user `8ba6404fa2614d3bb7fdcd166c98ea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:54.586889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8bfd0b98-11d5-48c5-9c3c-16ea207b4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:54.697916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243690d-326e-46a4-95ca-37bb6c2573ef admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:54.716490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1079/2129] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:54 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:54.764449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd0b98-11d5-48c5-9c3c-16ea207b4b3a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:54.766310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8bfd0b98-11d5-48c5-9c3c-16ea207b4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:54.791581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243690d-326e-46a4-95ca-37bb6c2573ef admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:54.806926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:54.807734 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.808105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.808538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] PATH_INFO: `/v3/users/b2fe7b0606234800b6358365aa89fac3` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.811036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2fe7b0606234800b6358365aa89fac3)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:54.815557 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:54.862802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd0b98-11d5-48c5-9c3c-16ea207b4b3a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:54.869862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c129f-b563-41ee-a8d7-1b06c3deafe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:54.870603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c129f-b563-41ee-a8d7-1b06c3deafe2 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:54.870991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c129f-b563-41ee-a8d7-1b06c3deafe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:54.871424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c129f-b563-41ee-a8d7-1b06c3deafe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:54.883663 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c129f-b563-41ee-a8d7-1b06c3deafe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:54.886260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c129f-b563-41ee-a8d7-1b06c3deafe2 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:54.915633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1080/2130] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:54.934588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:55.081026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2fe7b0606234800b6358365aa89fac3'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:55.082012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2fe7b0606234800b6358365aa89fac3'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:55.084228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2fe7b0606234800b6358365aa89fac3'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:55.119990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2fe7b0606234800b6358365aa89fac3'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:55.217302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8c3ce6a-5a99-47ad-9917-933fab1a72bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2fe7b0606234800b6358365aa89fac3'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:55.243830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c129f-b563-41ee-a8d7-1b06c3deafe2 service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:55.250704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1051/2131] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:54 2022] DELETE /identity/v3/users/b2fe7b0606234800b6358365aa89fac3 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:55:55.254224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34d73-4fe4-47ff-a07a-87b6ce3bea16 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:55.258313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34d73-4fe4-47ff-a07a-87b6ce3bea16 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:55.258807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34d73-4fe4-47ff-a07a-87b6ce3bea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:55.264088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c129f-b563-41ee-a8d7-1b06c3deafe2 service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:55.300325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-f2d34d73-4fe4-47ff-a07a-87b6ce3bea16 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:55.303238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f2d34d73-4fe4-47ff-a07a-87b6ce3bea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:55.374287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:55.427004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ad4a9-6cc7-4733-91d3-61f9432a0a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:55.428834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ad4a9-6cc7-4733-91d3-61f9432a0a7c service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:55.431950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ad4a9-6cc7-4733-91d3-61f9432a0a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:55.434091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ad4a9-6cc7-4733-91d3-61f9432a0a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:55.454046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cf1ad4a9-6cc7-4733-91d3-61f9432a0a7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:55.456722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1052/2132] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:55.508803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d34d73-4fe4-47ff-a07a-87b6ce3bea16 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:55.510511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f2d34d73-4fe4-47ff-a07a-87b6ce3bea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:55.530000 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ad4a9-6cc7-4733-91d3-61f9432a0a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:55.531707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ad4a9-6cc7-4733-91d3-61f9432a0a7c service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:55.542667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1081/2133] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:55.642770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d34d73-4fe4-47ff-a07a-87b6ce3bea16 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:55.659068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2923f-2be7-46bc-98f8-5df8c10f64b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:55.659743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2923f-2be7-46bc-98f8-5df8c10f64b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:55.661474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2923f-2be7-46bc-98f8-5df8c10f64b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:55.661474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2923f-2be7-46bc-98f8-5df8c10f64b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:55.673907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2923f-2be7-46bc-98f8-5df8c10f64b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:55.675422 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2923f-2be7-46bc-98f8-5df8c10f64b9 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:55.695371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1053/2134] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:55.747545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:56.242335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0950e7-b84d-492d-b0da-5d021c0ba632 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:56.242895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0950e7-b84d-492d-b0da-5d021c0ba632 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:56.243410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0950e7-b84d-492d-b0da-5d021c0ba632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:56.278187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-4d0950e7-b84d-492d-b0da-5d021c0ba632 None None] MFA Rules not processed for user `9d544d38a5664f68bff83e6c9798ffd9`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:56.279554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4d0950e7-b84d-492d-b0da-5d021c0ba632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:56.398072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1082/2135] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:56.443025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:56.571379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2923f-2be7-46bc-98f8-5df8c10f64b9 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:56.573528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6ae2923f-2be7-46bc-98f8-5df8c10f64b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:56.618393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2923f-2be7-46bc-98f8-5df8c10f64b9 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:56.627564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:56.629706 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:56.637607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:56.637971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] PATH_INFO: `/v3/projects/3926897ae7b4463db655d89cb0a178af` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:56.640035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3926897ae7b4463db655d89cb0a178af)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:56.642311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:56.784044 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3926897ae7b4463db655d89cb0a178af', 'request_id': 'req-2067dbc0-30ed-4d52-99e9-99913ef3fa37'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:56.950893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3926897ae7b4463db655d89cb0a178af', 'request_id': 'req-2067dbc0-30ed-4d52-99e9-99913ef3fa37'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:56.959704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3926897ae7b4463db655d89cb0a178af', 'request_id': 'req-2067dbc0-30ed-4d52-99e9-99913ef3fa37'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:56.970990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] The token cache is being invalidate because project 3926897ae7b4463db655d89cb0a178af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:56.971610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:56.972522 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:56.977413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1054/2136] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:56 2022] DELETE /identity/v3/projects/3926897ae7b4463db655d89cb0a178af => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:56.979812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0950e7-b84d-492d-b0da-5d021c0ba632 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:57.000550 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0950e7-b84d-492d-b0da-5d021c0ba632 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:57.020808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:57.096485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:57.097203 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:57.098654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:57.099084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] PATH_INFO: `/v3/users/9c8f6658ca7f4fedad9669783a06e4a8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:57.101569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c8f6658ca7f4fedad9669783a06e4a8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:57.107954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:57.397756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c8f6658ca7f4fedad9669783a06e4a8'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:57.403440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c8f6658ca7f4fedad9669783a06e4a8'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:57.403440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c8f6658ca7f4fedad9669783a06e4a8'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:57.511623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c8f6658ca7f4fedad9669783a06e4a8'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:57.547314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4bfe02e8-4d09-4214-a5e8-aedd8b071ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c8f6658ca7f4fedad9669783a06e4a8'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:57.568221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1083/2137] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:56 2022] DELETE /identity/v3/users/9c8f6658ca7f4fedad9669783a06e4a8 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:58.164859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:58.168388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:58.205727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067dbc0-30ed-4d52-99e9-99913ef3fa37 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:58.296113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:58.299727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:58.299727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:58.299727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] PATH_INFO: `/v3/projects/c666bb8daa02402fa1c8f19aff35cddb` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:58.299727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c666bb8daa02402fa1c8f19aff35cddb)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:58.300762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:58.422115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c666bb8daa02402fa1c8f19aff35cddb', 'request_id': 'req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:58.510948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c666bb8daa02402fa1c8f19aff35cddb', 'request_id': 'req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:58.519385 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c666bb8daa02402fa1c8f19aff35cddb', 'request_id': 'req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:58.531777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] The token cache is being invalidate because project c666bb8daa02402fa1c8f19aff35cddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:55:58.531908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:58.532624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5fb7d26b-ca6e-40e1-953e-0d2b2da7905c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:58.534140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1055/2138] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:55:58 2022] DELETE /identity/v3/projects/c666bb8daa02402fa1c8f19aff35cddb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:58.539804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c31dd1-ab4c-4c4b-8041-493aa9e11f45 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:58.540261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c31dd1-ab4c-4c4b-8041-493aa9e11f45 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:58.540535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c31dd1-ab4c-4c4b-8041-493aa9e11f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:58.571573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-93c31dd1-ab4c-4c4b-8041-493aa9e11f45 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:58.571573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-93c31dd1-ab4c-4c4b-8041-493aa9e11f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:58.673315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1084/2139] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:58.683852 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612ed86-9fe2-43db-8a9b-de332582dc22 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:58.684475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612ed86-9fe2-43db-8a9b-de332582dc22 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:58.684932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612ed86-9fe2-43db-8a9b-de332582dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:58.728313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6612ed86-9fe2-43db-8a9b-de332582dc22 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:58.734974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6612ed86-9fe2-43db-8a9b-de332582dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:58.758927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1056/2140] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:58.763159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c31dd1-ab4c-4c4b-8041-493aa9e11f45 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:58.778240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c31dd1-ab4c-4c4b-8041-493aa9e11f45 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:58.796623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11588a-a034-4cf0-9a5f-f1ffabc804eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:58.797248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11588a-a034-4cf0-9a5f-f1ffabc804eb admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:58.797570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11588a-a034-4cf0-9a5f-f1ffabc804eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:58.797836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11588a-a034-4cf0-9a5f-f1ffabc804eb admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:58.798491 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11588a-a034-4cf0-9a5f-f1ffabc804eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:55:58.798814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11588a-a034-4cf0-9a5f-f1ffabc804eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:58.800451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11588a-a034-4cf0-9a5f-f1ffabc804eb admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:58.857760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1085/2141] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:55:58.860895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612ed86-9fe2-43db-8a9b-de332582dc22 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:58.871136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612ed86-9fe2-43db-8a9b-de332582dc22 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:58.876844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11628989-0062-49bf-89c4-7b7a6964a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:58.877695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11628989-0062-49bf-89c4-7b7a6964a983 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:58.878171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11628989-0062-49bf-89c4-7b7a6964a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:58.879647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11628989-0062-49bf-89c4-7b7a6964a983 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:58.882189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11628989-0062-49bf-89c4-7b7a6964a983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:58.882727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:58.885242 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11628989-0062-49bf-89c4-7b7a6964a983 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:58.992499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1057/2142] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:55:58 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:58.999997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11588a-a034-4cf0-9a5f-f1ffabc804eb admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:59.011469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11588a-a034-4cf0-9a5f-f1ffabc804eb admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:59.092155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519604c0-a8b3-4c25-9710-b2f2362fe227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:59.092764 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519604c0-a8b3-4c25-9710-b2f2362fe227 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:59.093075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519604c0-a8b3-4c25-9710-b2f2362fe227 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:59.093359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519604c0-a8b3-4c25-9710-b2f2362fe227 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:59.094103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519604c0-a8b3-4c25-9710-b2f2362fe227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:59.096100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519604c0-a8b3-4c25-9710-b2f2362fe227 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:59.226349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1086/2143] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:55:58 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:55:59.230401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11628989-0062-49bf-89c4-7b7a6964a983 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:59.253230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11628989-0062-49bf-89c4-7b7a6964a983 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:59.271740 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444fdb8-17f3-4059-b90a-494db398ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:59.272663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444fdb8-17f3-4059-b90a-494db398ae6f admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:59.273146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444fdb8-17f3-4059-b90a-494db398ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:59.273650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444fdb8-17f3-4059-b90a-494db398ae6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:59.274575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444fdb8-17f3-4059-b90a-494db398ae6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:59.276445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444fdb8-17f3-4059-b90a-494db398ae6f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:59.291982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1058/2144] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:55:59.295737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519604c0-a8b3-4c25-9710-b2f2362fe227 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:59.311101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519604c0-a8b3-4c25-9710-b2f2362fe227 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:59.317402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1611591-db6d-4cc3-9626-dec6da8ed057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:59.318089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611591-db6d-4cc3-9626-dec6da8ed057 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:59.319087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611591-db6d-4cc3-9626-dec6da8ed057 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:59.319635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1611591-db6d-4cc3-9626-dec6da8ed057 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:59.320396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611591-db6d-4cc3-9626-dec6da8ed057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:59.322440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1611591-db6d-4cc3-9626-dec6da8ed057 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:59.335115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1087/2145] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:55:59.339367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444fdb8-17f3-4059-b90a-494db398ae6f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:59.350539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444fdb8-17f3-4059-b90a-494db398ae6f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:59.356550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b165edc-cafb-47dd-8896-fc1a2d8f4247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:59.357367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b165edc-cafb-47dd-8896-fc1a2d8f4247 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:59.357728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b165edc-cafb-47dd-8896-fc1a2d8f4247 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:59.358114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b165edc-cafb-47dd-8896-fc1a2d8f4247 admin admin] PATH_INFO: `/v3/projects/c9e56e67917244a9913850e6c3adaded/users/819f69f9d790450ead58922614853996/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:59.373641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:59.377434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b165edc-cafb-47dd-8896-fc1a2d8f4247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e56e67917244a9913850e6c3adaded, user_id=819f69f9d790450ead58922614853996, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:59.384219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b165edc-cafb-47dd-8896-fc1a2d8f4247 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:59.444278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1059/2146] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:55:59 2022] PUT /identity/v3/projects/c9e56e67917244a9913850e6c3adaded/users/819f69f9d790450ead58922614853996/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:55:59.456322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ff58-b0ba-4c50-979f-f8fdef83c25c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:59.463054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ff58-b0ba-4c50-979f-f8fdef83c25c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:59.463054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97ff58-b0ba-4c50-979f-f8fdef83c25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:59.489747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-4c97ff58-b0ba-4c50-979f-f8fdef83c25c None None] MFA Rules not processed for user `819f69f9d790450ead58922614853996`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:59.491069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4c97ff58-b0ba-4c50-979f-f8fdef83c25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:59.564315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1088/2147] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:55:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:59.574201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b165edc-cafb-47dd-8896-fc1a2d8f4247 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:59.583851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6b165edc-cafb-47dd-8896-fc1a2d8f4247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:59.588392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97ff58-b0ba-4c50-979f-f8fdef83c25c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:59.590581 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4c97ff58-b0ba-4c50-979f-f8fdef83c25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:59.663698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97ff58-b0ba-4c50-979f-f8fdef83c25c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:59.667796 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7069a-8c3f-4df6-8fee-e0a1239690e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:59.668608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7069a-8c3f-4df6-8fee-e0a1239690e0 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:59.669087 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7069a-8c3f-4df6-8fee-e0a1239690e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:59.669508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7069a-8c3f-4df6-8fee-e0a1239690e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:59.674052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b165edc-cafb-47dd-8896-fc1a2d8f4247 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:59.679622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:59.680315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:59.680746 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:59.680983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7069a-8c3f-4df6-8fee-e0a1239690e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:59.681100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] PATH_INFO: `/v3/users/a9ddcfa5e84a405da72e84318be3f308` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:59.682268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ddcfa5e84a405da72e84318be3f308)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:59.683392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7069a-8c3f-4df6-8fee-e0a1239690e0 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:59.684270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:59.693184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1089/2148] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:59.719815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7069a-8c3f-4df6-8fee-e0a1239690e0 service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:59.731257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7069a-8c3f-4df6-8fee-e0a1239690e0 service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:59.736044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:59.736658 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:59.736933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:59.737268 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] PATH_INFO: `/v3/users/819f69f9d790450ead58922614853996` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:59.738465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=819f69f9d790450ead58922614853996)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:59.740992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:59.913673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ddcfa5e84a405da72e84318be3f308'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:59.914412 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ddcfa5e84a405da72e84318be3f308'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:59.915560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ddcfa5e84a405da72e84318be3f308'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:55:59.931524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ddcfa5e84a405da72e84318be3f308'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.000010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819f69f9d790450ead58922614853996'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.000758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819f69f9d790450ead58922614853996'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.001890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819f69f9d790450ead58922614853996'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.074965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8e35b943-508e-40bb-afa3-ed52e26d62c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ddcfa5e84a405da72e84318be3f308'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.112511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1060/2149] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:59 2022] DELETE /identity/v3/users/a9ddcfa5e84a405da72e84318be3f308 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:00.150898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819f69f9d790450ead58922614853996'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.170788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819f69f9d790450ead58922614853996'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.199572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1090/2150] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:55:59 2022] DELETE /identity/v3/users/819f69f9d790450ead58922614853996 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:00.201404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6105-4b3d-489e-bd2d-8718ac28d1d6 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:00.201823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6105-4b3d-489e-bd2d-8718ac28d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:00.202213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6105-4b3d-489e-bd2d-8718ac28d1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:00.241195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-7e0a6105-4b3d-489e-bd2d-8718ac28d1d6 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:00.242557 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7e0a6105-4b3d-489e-bd2d-8718ac28d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:00.339977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1061/2151] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:00.350738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:00.352173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:00.471184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cde866-656a-4502-9c92-708ef3870cb1 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:00.479025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de0747-70b2-48c3-a9a7-9a909b9afb74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:00.479795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de0747-70b2-48c3-a9a7-9a909b9afb74 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:00.484019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de0747-70b2-48c3-a9a7-9a909b9afb74 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:00.484019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de0747-70b2-48c3-a9a7-9a909b9afb74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:00.492486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de0747-70b2-48c3-a9a7-9a909b9afb74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:00.494018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de0747-70b2-48c3-a9a7-9a909b9afb74 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:00.506277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1091/2152] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:00.515689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6105-4b3d-489e-bd2d-8718ac28d1d6 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:00.517197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7e0a6105-4b3d-489e-bd2d-8718ac28d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:00.533256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6105-4b3d-489e-bd2d-8718ac28d1d6 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:00.575468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:00.576019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:00.576379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:00.576572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] PATH_INFO: `/v3/projects/01d3d55f3b8b40b6ad0348d9accbb2c0` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:00.584690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d3d55f3b8b40b6ad0348d9accbb2c0)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:00.585635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:00.735521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d3d55f3b8b40b6ad0348d9accbb2c0', 'request_id': 'req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.790646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d3d55f3b8b40b6ad0348d9accbb2c0', 'request_id': 'req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.798136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d3d55f3b8b40b6ad0348d9accbb2c0', 'request_id': 'req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.809622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] The token cache is being invalidate because project 01d3d55f3b8b40b6ad0348d9accbb2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:00.809909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.810581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e1b4037c-a4ae-447d-99f7-a2fa6e01ed5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:00.812597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1062/2153] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:00 2022] DELETE /identity/v3/projects/01d3d55f3b8b40b6ad0348d9accbb2c0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:00.817699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f051ed-c23d-4f8d-b725-168a31d46840 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:00.818600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f051ed-c23d-4f8d-b725-168a31d46840 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:00.819086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f051ed-c23d-4f8d-b725-168a31d46840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:00.854710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-a0f051ed-c23d-4f8d-b725-168a31d46840 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:00.855061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a0f051ed-c23d-4f8d-b725-168a31d46840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:00.921730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1092/2154] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:00.929829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333c22f-d780-41f2-a70d-2649812aae5c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:00.930117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333c22f-d780-41f2-a70d-2649812aae5c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:00.930394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333c22f-d780-41f2-a70d-2649812aae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:00.940964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:00.952432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-f333c22f-d780-41f2-a70d-2649812aae5c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:00.953759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f333c22f-d780-41f2-a70d-2649812aae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:00.963907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1063/2155] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:00.969574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f051ed-c23d-4f8d-b725-168a31d46840 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:00.981277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f051ed-c23d-4f8d-b725-168a31d46840 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:00.988124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:00.989361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:00.989361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:00.989592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:00.990196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:56:00.990505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:00.992148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.005114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1093/2156] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:56:01.009498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:01.010726 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333c22f-d780-41f2-a70d-2649812aae5c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:01.013101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.021590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333c22f-d780-41f2-a70d-2649812aae5c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:01.026447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd1c02-288c-4075-88e4-acb75ec237f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:01.027063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd1c02-288c-4075-88e4-acb75ec237f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.027379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd1c02-288c-4075-88e4-acb75ec237f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.027660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd1c02-288c-4075-88e4-acb75ec237f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.028312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd1c02-288c-4075-88e4-acb75ec237f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:01.030243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd1c02-288c-4075-88e4-acb75ec237f1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.031854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fe991-f2e6-4838-a00d-330eb930b5ab admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:01.038503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:01.039487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.039984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.040858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] PATH_INFO: `/v3/users/b0fe8ea26c5c4858ad699972a0ae38ea` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.042045 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0fe8ea26c5c4858ad699972a0ae38ea)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:01.045207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.152119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1064/2157] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:01 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:01.156159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd1c02-288c-4075-88e4-acb75ec237f1 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:01.224477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd1c02-288c-4075-88e4-acb75ec237f1 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:01.229166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f002c-230b-4369-8526-670ec27ce339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:01.229776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f002c-230b-4369-8526-670ec27ce339 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.230136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f002c-230b-4369-8526-670ec27ce339 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.230424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f002c-230b-4369-8526-670ec27ce339 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.231052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f002c-230b-4369-8526-670ec27ce339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:01.233097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f002c-230b-4369-8526-670ec27ce339 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.274706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0fe8ea26c5c4858ad699972a0ae38ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.275482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0fe8ea26c5c4858ad699972a0ae38ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.276098 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0fe8ea26c5c4858ad699972a0ae38ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.348927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0fe8ea26c5c4858ad699972a0ae38ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.355820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1065/2158] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:01 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:01.356768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f002c-230b-4369-8526-670ec27ce339 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:01.361152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8c2f002c-230b-4369-8526-670ec27ce339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.376832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0fe8ea26c5c4858ad699972a0ae38ea'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.383773 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f002c-230b-4369-8526-670ec27ce339 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:01.390689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:01.391342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.391635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.391912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] PATH_INFO: `/v3/projects/c9e56e67917244a9913850e6c3adaded` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.393065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e56e67917244a9913850e6c3adaded)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:01.395035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.399786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1094/2159] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:01 2022] DELETE /identity/v3/users/b0fe8ea26c5c4858ad699972a0ae38ea => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:01.402623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:01.404676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.422425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:01.485580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237797d-3f7c-4c76-9941-5ddd044f293a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:01.491147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81be07-0090-450f-bd5d-830fc32f6995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:01.491822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81be07-0090-450f-bd5d-830fc32f6995 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.494511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81be07-0090-450f-bd5d-830fc32f6995 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.494511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81be07-0090-450f-bd5d-830fc32f6995 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.494511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81be07-0090-450f-bd5d-830fc32f6995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:01.494839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81be07-0090-450f-bd5d-830fc32f6995 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.505336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1095/2160] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:01.506642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccacd9d-9530-467a-a500-ae7c07551705 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.506937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccacd9d-9530-467a-a500-ae7c07551705 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.507215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccacd9d-9530-467a-a500-ae7c07551705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.526199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7ccacd9d-9530-467a-a500-ae7c07551705 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:01.527464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7ccacd9d-9530-467a-a500-ae7c07551705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.528879 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e56e67917244a9913850e6c3adaded', 'request_id': 'req-a4f5d101-463f-4941-b42c-817aa2db0624'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.592838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1096/2161] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:01.596748 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccacd9d-9530-467a-a500-ae7c07551705 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:01.606620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccacd9d-9530-467a-a500-ae7c07551705 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:01.613983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b45b8-e66e-4474-ba9e-5ba98ccb516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:01.613983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b45b8-e66e-4474-ba9e-5ba98ccb516d admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.613983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b45b8-e66e-4474-ba9e-5ba98ccb516d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.613983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b45b8-e66e-4474-ba9e-5ba98ccb516d admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.614737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b45b8-e66e-4474-ba9e-5ba98ccb516d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:01.615736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b45b8-e66e-4474-ba9e-5ba98ccb516d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.634426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1097/2162] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:01.634426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b45b8-e66e-4474-ba9e-5ba98ccb516d admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:01.635911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e56e67917244a9913850e6c3adaded', 'request_id': 'req-a4f5d101-463f-4941-b42c-817aa2db0624'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.636152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6f3b45b8-e66e-4474-ba9e-5ba98ccb516d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.649580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e56e67917244a9913850e6c3adaded', 'request_id': 'req-a4f5d101-463f-4941-b42c-817aa2db0624'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.663507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] The token cache is being invalidate because project c9e56e67917244a9913850e6c3adaded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:01.664124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.665433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:01.668070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1066/2163] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:01 2022] DELETE /identity/v3/projects/c9e56e67917244a9913850e6c3adaded => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:01.669841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:01.671669 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.686984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5d101-463f-4941-b42c-817aa2db0624 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:01.693890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a25ad-84ba-4576-8705-c93ba135684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:01.695434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a25ad-84ba-4576-8705-c93ba135684b admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.695905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a25ad-84ba-4576-8705-c93ba135684b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.696361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a25ad-84ba-4576-8705-c93ba135684b admin admin] PATH_INFO: `/v3/projects/0fc41c8a05be46b8950cfa1808eb5855/users/601dc79382404e90a6acd32d118d13a5/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.707007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b45b8-e66e-4474-ba9e-5ba98ccb516d admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:01.711494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938716-0f68-45bf-b2eb-9814a0fc409c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:01.712108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938716-0f68-45bf-b2eb-9814a0fc409c service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.712413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938716-0f68-45bf-b2eb-9814a0fc409c service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.712809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938716-0f68-45bf-b2eb-9814a0fc409c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.714922 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2e938716-0f68-45bf-b2eb-9814a0fc409c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.720466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a25ad-84ba-4576-8705-c93ba135684b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc41c8a05be46b8950cfa1808eb5855, user_id=601dc79382404e90a6acd32d118d13a5, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:01.722060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a25ad-84ba-4576-8705-c93ba135684b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.729539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e938716-0f68-45bf-b2eb-9814a0fc409c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:01.731075 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e938716-0f68-45bf-b2eb-9814a0fc409c service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:01.742848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1098/2164] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:01.744147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c7863-b44b-451f-8a85-7f99282978e1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.744983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c7863-b44b-451f-8a85-7f99282978e1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.744983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c7863-b44b-451f-8a85-7f99282978e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.770853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-a48c7863-b44b-451f-8a85-7f99282978e1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:01.772932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a48c7863-b44b-451f-8a85-7f99282978e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.782756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1099/2165] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:01.792095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2eecb-0b25-4556-8132-4fcd888128e6 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.792389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2eecb-0b25-4556-8132-4fcd888128e6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.792680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2eecb-0b25-4556-8132-4fcd888128e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.822119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1067/2166] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:01 2022] PUT /identity/v3/projects/0fc41c8a05be46b8950cfa1808eb5855/users/601dc79382404e90a6acd32d118d13a5/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:01.825347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa085c5-1d57-4d85-a67e-036c5f13ac9f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.825649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa085c5-1d57-4d85-a67e-036c5f13ac9f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.825934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa085c5-1d57-4d85-a67e-036c5f13ac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.877637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-eaa085c5-1d57-4d85-a67e-036c5f13ac9f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:01.879602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-eaa085c5-1d57-4d85-a67e-036c5f13ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:01.880915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-13f2eecb-0b25-4556-8132-4fcd888128e6 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:01.889590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-13f2eecb-0b25-4556-8132-4fcd888128e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:02.001339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1068/2167] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:02.008638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1100/2168] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:02.009495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa085c5-1d57-4d85-a67e-036c5f13ac9f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.017236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2eecb-0b25-4556-8132-4fcd888128e6 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.020460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-13f2eecb-0b25-4556-8132-4fcd888128e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:02.027248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa085c5-1d57-4d85-a67e-036c5f13ac9f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.038274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26165be3-079d-4f57-864a-6d40d3806822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.040417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26165be3-079d-4f57-864a-6d40d3806822 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.040417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26165be3-079d-4f57-864a-6d40d3806822 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.040417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26165be3-079d-4f57-864a-6d40d3806822 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.040417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26165be3-079d-4f57-864a-6d40d3806822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:56:02.040417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26165be3-079d-4f57-864a-6d40d3806822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:02.042164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26165be3-079d-4f57-864a-6d40d3806822 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:02.054739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1069/2169] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:56:02.059487 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26165be3-079d-4f57-864a-6d40d3806822 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.071141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26165be3-079d-4f57-864a-6d40d3806822 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.083463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b425-d525-4f77-adde-6ffd059fb912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.084176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b425-d525-4f77-adde-6ffd059fb912 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.088642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b425-d525-4f77-adde-6ffd059fb912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.088642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b425-d525-4f77-adde-6ffd059fb912 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.088642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b425-d525-4f77-adde-6ffd059fb912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:02.088642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b425-d525-4f77-adde-6ffd059fb912 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:02.123783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2eecb-0b25-4556-8132-4fcd888128e6 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.130618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe10a1b-b1cd-401b-a99c-b6e8597ebb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.131398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe10a1b-b1cd-401b-a99c-b6e8597ebb90 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.136943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe10a1b-b1cd-401b-a99c-b6e8597ebb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.136943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe10a1b-b1cd-401b-a99c-b6e8597ebb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.148779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe10a1b-b1cd-401b-a99c-b6e8597ebb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:02.150300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe10a1b-b1cd-401b-a99c-b6e8597ebb90 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:02.171459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1101/2170] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:02.190424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1070/2171] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:02 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:02.193798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe10a1b-b1cd-401b-a99c-b6e8597ebb90 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.204631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe10a1b-b1cd-401b-a99c-b6e8597ebb90 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.286162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84bfd-2973-441c-be0f-991f731a1481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.287539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84bfd-2973-441c-be0f-991f731a1481 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.288033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84bfd-2973-441c-be0f-991f731a1481 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.288679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84bfd-2973-441c-be0f-991f731a1481 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.290398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a84bfd-2973-441c-be0f-991f731a1481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:02.293681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a84bfd-2973-441c-be0f-991f731a1481 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:02.424277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1102/2172] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:02 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:02.429038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b425-d525-4f77-adde-6ffd059fb912 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.440140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b425-d525-4f77-adde-6ffd059fb912 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.445122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ad8a2-7f16-46a7-8968-6c72c27028ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.445722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ad8a2-7f16-46a7-8968-6c72c27028ff admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.449256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ad8a2-7f16-46a7-8968-6c72c27028ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.449256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ad8a2-7f16-46a7-8968-6c72c27028ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.449256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ad8a2-7f16-46a7-8968-6c72c27028ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:02.449256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ad8a2-7f16-46a7-8968-6c72c27028ff admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:02.468298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1071/2173] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:02.470007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84bfd-2973-441c-be0f-991f731a1481 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.497144 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84bfd-2973-441c-be0f-991f731a1481 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.502353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bde88-3299-4635-8745-f391417e4119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.503188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bde88-3299-4635-8745-f391417e4119 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.503495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bde88-3299-4635-8745-f391417e4119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.503994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bde88-3299-4635-8745-f391417e4119 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.504723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bde88-3299-4635-8745-f391417e4119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:02.520646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bde88-3299-4635-8745-f391417e4119 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:02.536260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1103/2174] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:02.541030 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ad8a2-7f16-46a7-8968-6c72c27028ff admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.559142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ad8a2-7f16-46a7-8968-6c72c27028ff admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.559400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bde88-3299-4635-8745-f391417e4119 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.564840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7c9bde88-3299-4635-8745-f391417e4119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:02.566035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bf3ba-0360-49c1-8f32-e10eb2949b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.566990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf3ba-0360-49c1-8f32-e10eb2949b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.567568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf3ba-0360-49c1-8f32-e10eb2949b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.568018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf3ba-0360-49c1-8f32-e10eb2949b3c admin admin] PATH_INFO: `/v3/projects/81c7df6d06aa4fe0bf065921b08afe7f/users/6c2704c142f54c9e8e1058ff8111bb83/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.586057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bf3ba-0360-49c1-8f32-e10eb2949b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c7df6d06aa4fe0bf065921b08afe7f, user_id=6c2704c142f54c9e8e1058ff8111bb83, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:02.586881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bde88-3299-4635-8745-f391417e4119 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.590185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072bf3ba-0360-49c1-8f32-e10eb2949b3c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:02.592142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.592790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.593059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.593334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] PATH_INFO: `/v3/projects/c476903a25a34c17899121f094b63d41` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.595113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c476903a25a34c17899121f094b63d41)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:02.597134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:02.692031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1072/2175] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:02 2022] PUT /identity/v3/projects/81c7df6d06aa4fe0bf065921b08afe7f/users/6c2704c142f54c9e8e1058ff8111bb83/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:02.697022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec1f2-e8fd-4266-acd5-388a580a4eac None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.697394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec1f2-e8fd-4266-acd5-388a580a4eac None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.697743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec1f2-e8fd-4266-acd5-388a580a4eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.717211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-82fec1f2-e8fd-4266-acd5-388a580a4eac None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:02.719676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-82fec1f2-e8fd-4266-acd5-388a580a4eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:02.766685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c476903a25a34c17899121f094b63d41', 'request_id': 'req-cc11b97a-6be7-4692-82ac-fe5efb43a79a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:02.777251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c476903a25a34c17899121f094b63d41', 'request_id': 'req-cc11b97a-6be7-4692-82ac-fe5efb43a79a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:02.813962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1073/2176] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:02.825627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fec1f2-e8fd-4266-acd5-388a580a4eac None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.827020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-82fec1f2-e8fd-4266-acd5-388a580a4eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:02.899357 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fec1f2-e8fd-4266-acd5-388a580a4eac None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.918532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c476903a25a34c17899121f094b63d41', 'request_id': 'req-cc11b97a-6be7-4692-82ac-fe5efb43a79a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:02.939260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] The token cache is being invalidate because project c476903a25a34c17899121f094b63d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:02.939744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:02.940535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:02.943606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1104/2177] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:02 2022] DELETE /identity/v3/projects/c476903a25a34c17899121f094b63d41 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:02.947990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.954176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:02.983009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cde61-7142-4fcd-8777-e37b3343dcb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.983637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cde61-7142-4fcd-8777-e37b3343dcb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.983918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cde61-7142-4fcd-8777-e37b3343dcb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.984191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cde61-7142-4fcd-8777-e37b3343dcb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.990354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2a9cde61-7142-4fcd-8777-e37b3343dcb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:03.033196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b97a-6be7-4692-82ac-fe5efb43a79a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:03.038053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:03.038822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:03.039115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:03.039430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] PATH_INFO: `/v3/users/8ba6404fa2614d3bb7fdcd166c98ea0a` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:03.040602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba6404fa2614d3bb7fdcd166c98ea0a)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:03.042527 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:03.072397 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cde61-7142-4fcd-8777-e37b3343dcb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:03.078471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cde61-7142-4fcd-8777-e37b3343dcb3 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:03.091083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1074/2178] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:56:03.235819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba6404fa2614d3bb7fdcd166c98ea0a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:03.236656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba6404fa2614d3bb7fdcd166c98ea0a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:03.237386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba6404fa2614d3bb7fdcd166c98ea0a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:03.310345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba6404fa2614d3bb7fdcd166c98ea0a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:03.330452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8b090407-6c1c-4e9b-a5a9-6aeb64d23958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba6404fa2614d3bb7fdcd166c98ea0a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:03.347215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1105/2179] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:02 2022] DELETE /identity/v3/users/8ba6404fa2614d3bb7fdcd166c98ea0a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:03.768927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:03.996817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:04.329373 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cde61-7142-4fcd-8777-e37b3343dcb3 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:04.343102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cde61-7142-4fcd-8777-e37b3343dcb3 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:04.438822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:04.439548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:04.439911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:04.440105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] PATH_INFO: `/v3/projects/2091224650c8426d9faf27f1dedf0f01` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:04.444200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2091224650c8426d9faf27f1dedf0f01)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:04.444200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:04.599710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2091224650c8426d9faf27f1dedf0f01', 'request_id': 'req-20be2e4d-edf0-4e6f-acbf-7533181f740d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:04.687614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2091224650c8426d9faf27f1dedf0f01', 'request_id': 'req-20be2e4d-edf0-4e6f-acbf-7533181f740d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:04.695229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2091224650c8426d9faf27f1dedf0f01', 'request_id': 'req-20be2e4d-edf0-4e6f-acbf-7533181f740d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:04.705406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] The token cache is being invalidate because project 2091224650c8426d9faf27f1dedf0f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:04.705691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:04.706338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-20be2e4d-edf0-4e6f-acbf-7533181f740d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:04.707874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1075/2180] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:04 2022] DELETE /identity/v3/projects/2091224650c8426d9faf27f1dedf0f01 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:04.712780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab296d-e45c-4e5c-97f9-ab7c4030d59e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:04.714618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab296d-e45c-4e5c-97f9-ab7c4030d59e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:04.714618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab296d-e45c-4e5c-97f9-ab7c4030d59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:04.732967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-99ab296d-e45c-4e5c-97f9-ab7c4030d59e None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:04.734165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-99ab296d-e45c-4e5c-97f9-ab7c4030d59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:04.808623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1106/2181] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:04.810850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbd352-545b-4aa1-bc60-c2f5f750be17 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:04.812060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbd352-545b-4aa1-bc60-c2f5f750be17 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:04.812440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbd352-545b-4aa1-bc60-c2f5f750be17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:04.836789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6fdbd352-545b-4aa1-bc60-c2f5f750be17 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:04.838888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6fdbd352-545b-4aa1-bc60-c2f5f750be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:04.849113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1076/2182] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:04.853882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab296d-e45c-4e5c-97f9-ab7c4030d59e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:04.865504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab296d-e45c-4e5c-97f9-ab7c4030d59e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:04.870746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df87d0-0fe2-478b-955d-d48fa47c13ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:04.871389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df87d0-0fe2-478b-955d-d48fa47c13ce admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:04.871670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df87d0-0fe2-478b-955d-d48fa47c13ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:04.871946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df87d0-0fe2-478b-955d-d48fa47c13ce admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:04.872752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df87d0-0fe2-478b-955d-d48fa47c13ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:56:04.873054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df87d0-0fe2-478b-955d-d48fa47c13ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:04.874725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df87d0-0fe2-478b-955d-d48fa47c13ce admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:04.889941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1107/2183] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:56:04.895789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbd352-545b-4aa1-bc60-c2f5f750be17 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:04.909428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbd352-545b-4aa1-bc60-c2f5f750be17 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:04.915430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093091df-b716-4587-a72b-20031f400911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:04.916138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093091df-b716-4587-a72b-20031f400911 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:04.916484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093091df-b716-4587-a72b-20031f400911 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:04.916856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093091df-b716-4587-a72b-20031f400911 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:04.917542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093091df-b716-4587-a72b-20031f400911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:04.919639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093091df-b716-4587-a72b-20031f400911 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:05.047458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1077/2184] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:04 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:05.048654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df87d0-0fe2-478b-955d-d48fa47c13ce admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:05.059245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df87d0-0fe2-478b-955d-d48fa47c13ce admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:05.130242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f2ed-6d66-4c3d-80cd-aa7378194add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:05.130874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f2ed-6d66-4c3d-80cd-aa7378194add admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:05.131168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f2ed-6d66-4c3d-80cd-aa7378194add admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:05.131509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f2ed-6d66-4c3d-80cd-aa7378194add admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:05.132143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f2ed-6d66-4c3d-80cd-aa7378194add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:05.134256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f2ed-6d66-4c3d-80cd-aa7378194add admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:05.255680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1108/2185] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:05 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:05.257281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093091df-b716-4587-a72b-20031f400911 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:05.273336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093091df-b716-4587-a72b-20031f400911 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:05.288738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf36c8-2f02-4b58-90b0-c30a93b111d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:05.288917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf36c8-2f02-4b58-90b0-c30a93b111d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:05.290337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf36c8-2f02-4b58-90b0-c30a93b111d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:05.290337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf36c8-2f02-4b58-90b0-c30a93b111d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:05.290684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf36c8-2f02-4b58-90b0-c30a93b111d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:05.292715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf36c8-2f02-4b58-90b0-c30a93b111d8 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:05.307541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1078/2186] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:05.311623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f2ed-6d66-4c3d-80cd-aa7378194add admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:05.342278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f2ed-6d66-4c3d-80cd-aa7378194add admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:05.358498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f7c07-6a45-40df-9ae0-5e5c300fd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:05.359684 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7c07-6a45-40df-9ae0-5e5c300fd302 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:05.360091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7c07-6a45-40df-9ae0-5e5c300fd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:05.360569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7c07-6a45-40df-9ae0-5e5c300fd302 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:05.361345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f7c07-6a45-40df-9ae0-5e5c300fd302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:05.365780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f7c07-6a45-40df-9ae0-5e5c300fd302 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:05.380888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1109/2187] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:56:05.384951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf36c8-2f02-4b58-90b0-c30a93b111d8 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:05.404408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf36c8-2f02-4b58-90b0-c30a93b111d8 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:05.430330 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f9fc3-4d28-475d-bf56-f7eb4fbcc12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:05.431001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f9fc3-4d28-475d-bf56-f7eb4fbcc12d admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:05.432767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f9fc3-4d28-475d-bf56-f7eb4fbcc12d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:05.432767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f9fc3-4d28-475d-bf56-f7eb4fbcc12d admin admin] PATH_INFO: `/v3/projects/263dc6bf7beb4b56831f72090334988d/users/5b6cee4e59bb4d13830f10797aed4157/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:05.475195 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f9fc3-4d28-475d-bf56-f7eb4fbcc12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=263dc6bf7beb4b56831f72090334988d, user_id=5b6cee4e59bb4d13830f10797aed4157, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:05.490160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f9fc3-4d28-475d-bf56-f7eb4fbcc12d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:05.581077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1079/2188] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:05 2022] PUT /identity/v3/projects/263dc6bf7beb4b56831f72090334988d/users/5b6cee4e59bb4d13830f10797aed4157/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:05.594327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d76d7-a362-4c2e-96d1-4ad35a633134 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:05.594623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d76d7-a362-4c2e-96d1-4ad35a633134 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:05.595081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d76d7-a362-4c2e-96d1-4ad35a633134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:05.645099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f81d76d7-a362-4c2e-96d1-4ad35a633134 None None] MFA Rules not processed for user `5b6cee4e59bb4d13830f10797aed4157`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:05.648650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f81d76d7-a362-4c2e-96d1-4ad35a633134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:05.700477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:05.761492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1110/2189] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:05.761870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f9fc3-4d28-475d-bf56-f7eb4fbcc12d admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:05.850268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f9fc3-4d28-475d-bf56-f7eb4fbcc12d admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:05.856016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7c41-4ccc-4883-a152-5f3e7b72f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:05.857191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7c41-4ccc-4883-a152-5f3e7b72f767 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:05.857658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7c41-4ccc-4883-a152-5f3e7b72f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:05.857918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7c41-4ccc-4883-a152-5f3e7b72f767 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:05.859096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7c41-4ccc-4883-a152-5f3e7b72f767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:05.861217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7c41-4ccc-4883-a152-5f3e7b72f767 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:05.983871 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1080/2190] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:05 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:05.989367 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:05.995266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d76d7-a362-4c2e-96d1-4ad35a633134 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:06.008286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d76d7-a362-4c2e-96d1-4ad35a633134 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:06.088484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241559f-b867-4df7-bfd4-2ed75d7205e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:06.089136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241559f-b867-4df7-bfd4-2ed75d7205e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:06.089420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241559f-b867-4df7-bfd4-2ed75d7205e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:06.089701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241559f-b867-4df7-bfd4-2ed75d7205e9 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:06.090341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241559f-b867-4df7-bfd4-2ed75d7205e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:06.092421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241559f-b867-4df7-bfd4-2ed75d7205e9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:06.156604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1111/2191] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:05 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:06.160997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7c41-4ccc-4883-a152-5f3e7b72f767 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:06.173641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7c41-4ccc-4883-a152-5f3e7b72f767 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:06.195411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c6ec-0028-4f35-a8e7-782910c9cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:06.195920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c6ec-0028-4f35-a8e7-782910c9cbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:06.196095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c6ec-0028-4f35-a8e7-782910c9cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:06.196332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c6ec-0028-4f35-a8e7-782910c9cbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:06.197175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c6ec-0028-4f35-a8e7-782910c9cbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:06.198959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c6ec-0028-4f35-a8e7-782910c9cbb6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:06.211614 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1081/2192] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:06.216447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241559f-b867-4df7-bfd4-2ed75d7205e9 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:06.227277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241559f-b867-4df7-bfd4-2ed75d7205e9 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:06.239371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bbf5f-3fb2-4bef-919d-26801a746804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:06.240071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bbf5f-3fb2-4bef-919d-26801a746804 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:06.240352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bbf5f-3fb2-4bef-919d-26801a746804 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:06.240851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bbf5f-3fb2-4bef-919d-26801a746804 admin admin] PATH_INFO: `/v3/projects/442cb23184124a318fb45b204afd6794/users/ebc9748f47c94de5bcda16cc7b2b9f8a/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:06.257972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bbf5f-3fb2-4bef-919d-26801a746804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442cb23184124a318fb45b204afd6794, user_id=ebc9748f47c94de5bcda16cc7b2b9f8a, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:06.261036 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bbf5f-3fb2-4bef-919d-26801a746804 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:06.371024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1112/2193] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:06 2022] PUT /identity/v3/projects/442cb23184124a318fb45b204afd6794/users/ebc9748f47c94de5bcda16cc7b2b9f8a/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:06.375069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c6ec-0028-4f35-a8e7-782910c9cbb6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:06.388474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c6ec-0028-4f35-a8e7-782910c9cbb6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:06.453272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bbf5f-3fb2-4bef-919d-26801a746804 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:06.456329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-603bbf5f-3fb2-4bef-919d-26801a746804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:06.540887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e374c5-fec4-449a-8722-6887e25f1d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:06.541770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e374c5-fec4-449a-8722-6887e25f1d65 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:06.542131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e374c5-fec4-449a-8722-6887e25f1d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:06.543038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e374c5-fec4-449a-8722-6887e25f1d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:06.545485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e374c5-fec4-449a-8722-6887e25f1d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:06.547800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e374c5-fec4-449a-8722-6887e25f1d65 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:06.566854 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1082/2194] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:06.569392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e374c5-fec4-449a-8722-6887e25f1d65 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:06.587166 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bbf5f-3fb2-4bef-919d-26801a746804 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:06.592444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:06.593111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:06.593405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:06.595897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] PATH_INFO: `/v3/users/6255bd8749744af0adff7c9928ac9ae6` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:06.597239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6255bd8749744af0adff7c9928ac9ae6)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:06.599857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:06.639407 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e374c5-fec4-449a-8722-6887e25f1d65 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:06.655091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3c643-13bf-4fd9-810d-aac5e2caf74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:06.656368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3c643-13bf-4fd9-810d-aac5e2caf74b admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:06.656731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3c643-13bf-4fd9-810d-aac5e2caf74b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:06.657094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3c643-13bf-4fd9-810d-aac5e2caf74b admin admin] PATH_INFO: `/v3/projects/442cb23184124a318fb45b204afd6794/users/ebc9748f47c94de5bcda16cc7b2b9f8a/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:06.659440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3c643-13bf-4fd9-810d-aac5e2caf74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=442cb23184124a318fb45b204afd6794, user_id=ebc9748f47c94de5bcda16cc7b2b9f8a, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:06.663767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3c643-13bf-4fd9-810d-aac5e2caf74b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:06.707692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1083/2195] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:06 2022] PUT /identity/v3/projects/442cb23184124a318fb45b204afd6794/users/ebc9748f47c94de5bcda16cc7b2b9f8a/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:06.709400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640f53b-e1d8-483b-a88a-a31c12accddf None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:06.709696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640f53b-e1d8-483b-a88a-a31c12accddf None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:06.709977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640f53b-e1d8-483b-a88a-a31c12accddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:06.759647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-0640f53b-e1d8-483b-a88a-a31c12accddf None None] MFA Rules not processed for user `ebc9748f47c94de5bcda16cc7b2b9f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:06.761027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0640f53b-e1d8-483b-a88a-a31c12accddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:06.793797 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6255bd8749744af0adff7c9928ac9ae6'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:06.796387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6255bd8749744af0adff7c9928ac9ae6'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:06.798970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6255bd8749744af0adff7c9928ac9ae6'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:06.898505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1084/2196] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:06.911062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640f53b-e1d8-483b-a88a-a31c12accddf None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:06.912990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0640f53b-e1d8-483b-a88a-a31c12accddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:06.930260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6255bd8749744af0adff7c9928ac9ae6'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:06.949577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-993fee87-0227-4eff-9145-6d7198636d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6255bd8749744af0adff7c9928ac9ae6'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:06.971531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1113/2197] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:06 2022] DELETE /identity/v3/users/6255bd8749744af0adff7c9928ac9ae6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:06.974198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1a3d0-e392-45f7-b8e3-30fcf5e7b0ca None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:06.974543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1a3d0-e392-45f7-b8e3-30fcf5e7b0ca None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:06.974823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1a3d0-e392-45f7-b8e3-30fcf5e7b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:07.002180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7cb1a3d0-e392-45f7-b8e3-30fcf5e7b0ca None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:07.003714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7cb1a3d0-e392-45f7-b8e3-30fcf5e7b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:07.080501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640f53b-e1d8-483b-a88a-a31c12accddf None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:07.081511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1114/2198] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:07.092434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1a3d0-e392-45f7-b8e3-30fcf5e7b0ca None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:07.094869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7cb1a3d0-e392-45f7-b8e3-30fcf5e7b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:07.112593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:07.173009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6881b7-8dc4-4e04-93b0-e05cc52ad884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:07.174013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6881b7-8dc4-4e04-93b0-e05cc52ad884 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:07.174303 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6881b7-8dc4-4e04-93b0-e05cc52ad884 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:07.174965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6881b7-8dc4-4e04-93b0-e05cc52ad884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:07.178198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bc6881b7-8dc4-4e04-93b0-e05cc52ad884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:07.209250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1a3d0-e392-45f7-b8e3-30fcf5e7b0ca None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:07.215503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df97de6-e9ad-4dfc-94aa-e3c53db2487c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:07.216185 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df97de6-e9ad-4dfc-94aa-e3c53db2487c service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:07.217000 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df97de6-e9ad-4dfc-94aa-e3c53db2487c service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:07.219178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df97de6-e9ad-4dfc-94aa-e3c53db2487c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:07.251233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df97de6-e9ad-4dfc-94aa-e3c53db2487c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:07.254237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df97de6-e9ad-4dfc-94aa-e3c53db2487c service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:07.271430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6881b7-8dc4-4e04-93b0-e05cc52ad884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:07.271430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6881b7-8dc4-4e04-93b0-e05cc52ad884 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:07.271785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1115/2199] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:07.282623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1085/2200] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:07.301016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:07.796694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:08.095012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df97de6-e9ad-4dfc-94aa-e3c53db2487c service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:08.096830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9df97de6-e9ad-4dfc-94aa-e3c53db2487c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:08.116921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df97de6-e9ad-4dfc-94aa-e3c53db2487c service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:08.129572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:08.129572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:08.129994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:08.130336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] PATH_INFO: `/v3/projects/489377cacb6748508fc9e284aa44f845` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:08.131791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] RBAC: Authorizing `identity:delete_project(project_id=489377cacb6748508fc9e284aa44f845)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:08.134547 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:08.351327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489377cacb6748508fc9e284aa44f845', 'request_id': 'req-35e0729a-5c21-4a32-a013-2aeea1e8575d'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:08.396007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489377cacb6748508fc9e284aa44f845', 'request_id': 'req-35e0729a-5c21-4a32-a013-2aeea1e8575d'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:08.487718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489377cacb6748508fc9e284aa44f845', 'request_id': 'req-35e0729a-5c21-4a32-a013-2aeea1e8575d'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:08.516919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] The token cache is being invalidate because project 489377cacb6748508fc9e284aa44f845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:08.517232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:08.518829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:08.526835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1116/2201] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:08 2022] DELETE /identity/v3/projects/489377cacb6748508fc9e284aa44f845 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:08.530907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6881b7-8dc4-4e04-93b0-e05cc52ad884 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:08.549518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6881b7-8dc4-4e04-93b0-e05cc52ad884 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:08.726522 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:08.727247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:08.727773 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:08.728155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] PATH_INFO: `/v3/users/f0d394be36c1444a9dab32297734bc9d` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:08.729366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d394be36c1444a9dab32297734bc9d)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:08.734757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:08.956214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d394be36c1444a9dab32297734bc9d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:08.956897 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d394be36c1444a9dab32297734bc9d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:08.959446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d394be36c1444a9dab32297734bc9d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:08.991773 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d394be36c1444a9dab32297734bc9d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:09.077155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5aa4be37-f51e-41a9-b9b9-7cf2fe9b1beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d394be36c1444a9dab32297734bc9d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:09.105205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1086/2202] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:08 2022] DELETE /identity/v3/users/f0d394be36c1444a9dab32297734bc9d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:09.453630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:09.510446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:10.128191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:10.137032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:10.161119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0729a-5c21-4a32-a013-2aeea1e8575d admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:10.300295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:10.301829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:10.306811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:10.307091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] PATH_INFO: `/v3/projects/3721bb96c63c45a6bb347116a71a76ce` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:10.312101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3721bb96c63c45a6bb347116a71a76ce)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:10.314903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:10.494089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3721bb96c63c45a6bb347116a71a76ce', 'request_id': 'req-7699be78-dfa5-433e-b409-6f1aa2aaa06e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:10.502011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3721bb96c63c45a6bb347116a71a76ce', 'request_id': 'req-7699be78-dfa5-433e-b409-6f1aa2aaa06e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:10.568094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3721bb96c63c45a6bb347116a71a76ce', 'request_id': 'req-7699be78-dfa5-433e-b409-6f1aa2aaa06e'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:10.637718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] The token cache is being invalidate because project 3721bb96c63c45a6bb347116a71a76ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:10.640167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:10.641500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7699be78-dfa5-433e-b409-6f1aa2aaa06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:10.648443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1117/2203] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:10 2022] DELETE /identity/v3/projects/3721bb96c63c45a6bb347116a71a76ce => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:10.658723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936572a-e637-4dfd-85be-8e51de2c3f01 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:10.658723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936572a-e637-4dfd-85be-8e51de2c3f01 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:10.658723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936572a-e637-4dfd-85be-8e51de2c3f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:10.684948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2936572a-e637-4dfd-85be-8e51de2c3f01 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:10.686245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2936572a-e637-4dfd-85be-8e51de2c3f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:10.802394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1087/2204] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:10.808060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21908d-87ba-4208-bde5-5e31d63adb54 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:10.812366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21908d-87ba-4208-bde5-5e31d63adb54 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:10.812366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21908d-87ba-4208-bde5-5e31d63adb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:10.851443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1c21908d-87ba-4208-bde5-5e31d63adb54 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:10.855387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1c21908d-87ba-4208-bde5-5e31d63adb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:10.880618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1118/2205] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:10.884864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936572a-e637-4dfd-85be-8e51de2c3f01 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:10.901458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936572a-e637-4dfd-85be-8e51de2c3f01 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:10.912735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80211f-b88c-4eb2-87af-a1298c9797ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:10.913371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80211f-b88c-4eb2-87af-a1298c9797ff admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:10.913655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80211f-b88c-4eb2-87af-a1298c9797ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:10.913933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80211f-b88c-4eb2-87af-a1298c9797ff admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:10.914591 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80211f-b88c-4eb2-87af-a1298c9797ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:56:10.918764 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80211f-b88c-4eb2-87af-a1298c9797ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:10.920780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80211f-b88c-4eb2-87af-a1298c9797ff admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:10.960275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1088/2206] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:56:10.963942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21908d-87ba-4208-bde5-5e31d63adb54 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:10.978918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21908d-87ba-4208-bde5-5e31d63adb54 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:11.000839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4b45c-2d68-46c9-80cc-0d0ab7977487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:11.001927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4b45c-2d68-46c9-80cc-0d0ab7977487 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:11.002407 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4b45c-2d68-46c9-80cc-0d0ab7977487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:11.002817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4b45c-2d68-46c9-80cc-0d0ab7977487 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:11.003892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4b45c-2d68-46c9-80cc-0d0ab7977487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:11.013438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4b45c-2d68-46c9-80cc-0d0ab7977487 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:11.177810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1119/2207] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:10 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:11.183433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80211f-b88c-4eb2-87af-a1298c9797ff admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:11.198558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80211f-b88c-4eb2-87af-a1298c9797ff admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:11.208876 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:11.353428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446377f-e970-46aa-b649-5aad3153c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:11.354238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446377f-e970-46aa-b649-5aad3153c331 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:11.360613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446377f-e970-46aa-b649-5aad3153c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:11.360926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446377f-e970-46aa-b649-5aad3153c331 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:11.361608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446377f-e970-46aa-b649-5aad3153c331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:11.368981 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446377f-e970-46aa-b649-5aad3153c331 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:11.387351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:11.574296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1089/2208] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:11 2022] POST /identity/v3/users => generated 290 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:11.575007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4b45c-2d68-46c9-80cc-0d0ab7977487 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:11.592731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4b45c-2d68-46c9-80cc-0d0ab7977487 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:11.611178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead00f2-0ab4-4d13-89a2-585e6a86885b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:11.611948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead00f2-0ab4-4d13-89a2-585e6a86885b admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:11.614441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead00f2-0ab4-4d13-89a2-585e6a86885b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:11.618882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead00f2-0ab4-4d13-89a2-585e6a86885b admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:11.622524 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead00f2-0ab4-4d13-89a2-585e6a86885b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:11.622524 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead00f2-0ab4-4d13-89a2-585e6a86885b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:11.666475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446377f-e970-46aa-b649-5aad3153c331 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:11.668233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1120/2209] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:11.677013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446377f-e970-46aa-b649-5aad3153c331 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:11.693470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f45df6-509d-4976-85f6-abca59444fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:11.694118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f45df6-509d-4976-85f6-abca59444fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:11.695132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f45df6-509d-4976-85f6-abca59444fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:11.695449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f45df6-509d-4976-85f6-abca59444fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:11.696120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f45df6-509d-4976-85f6-abca59444fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:11.704400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f45df6-509d-4976-85f6-abca59444fc7 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:11.744219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1090/2210] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:56:11.745452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead00f2-0ab4-4d13-89a2-585e6a86885b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:11.768981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead00f2-0ab4-4d13-89a2-585e6a86885b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:11.783557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2cb6b-508f-4646-b015-d7e9f8df52a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:11.784253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2cb6b-508f-4646-b015-d7e9f8df52a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:11.785061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2cb6b-508f-4646-b015-d7e9f8df52a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:11.789079 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2cb6b-508f-4646-b015-d7e9f8df52a5 admin admin] PATH_INFO: `/v3/projects/e76cc88296c44fe7a6c8e8c96f3a1157/users/aefeb7f64c144a4f8583d114f614e915/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:11.836873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2cb6b-508f-4646-b015-d7e9f8df52a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76cc88296c44fe7a6c8e8c96f3a1157, user_id=aefeb7f64c144a4f8583d114f614e915, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:11.849659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2cb6b-508f-4646-b015-d7e9f8df52a5 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:11.971124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1121/2211] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:11 2022] PUT /identity/v3/projects/e76cc88296c44fe7a6c8e8c96f3a1157/users/aefeb7f64c144a4f8583d114f614e915/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:11.983861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcbfe5-f139-4263-b523-dd15518b3c9b None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:11.984141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcbfe5-f139-4263-b523-dd15518b3c9b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:11.984421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcbfe5-f139-4263-b523-dd15518b3c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:12.064045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e9bcbfe5-f139-4263-b523-dd15518b3c9b None None] MFA Rules not processed for user `aefeb7f64c144a4f8583d114f614e915`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:12.065280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e9bcbfe5-f139-4263-b523-dd15518b3c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:12.163050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1091/2212] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:12.167679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2cb6b-508f-4646-b015-d7e9f8df52a5 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:12.281235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2cb6b-508f-4646-b015-d7e9f8df52a5 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:12.307667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cfb30-c549-4639-aa5b-1a5b9d8b3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:12.308584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cfb30-c549-4639-aa5b-1a5b9d8b3af3 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:12.309007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cfb30-c549-4639-aa5b-1a5b9d8b3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:12.309488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cfb30-c549-4639-aa5b-1a5b9d8b3af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:12.310319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cfb30-c549-4639-aa5b-1a5b9d8b3af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:12.313210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cfb30-c549-4639-aa5b-1a5b9d8b3af3 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:12.496270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1122/2213] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:12 2022] POST /identity/v3/projects => generated 377 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:12.500603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcbfe5-f139-4263-b523-dd15518b3c9b None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:12.519338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcbfe5-f139-4263-b523-dd15518b3c9b None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:12.669197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef748b7-71fd-497d-aef0-23dbb421a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:12.670699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef748b7-71fd-497d-aef0-23dbb421a7ea admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:12.671123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef748b7-71fd-497d-aef0-23dbb421a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:12.671664 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef748b7-71fd-497d-aef0-23dbb421a7ea admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:12.672757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef748b7-71fd-497d-aef0-23dbb421a7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:12.676136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef748b7-71fd-497d-aef0-23dbb421a7ea admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:12.777026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cfb30-c549-4639-aa5b-1a5b9d8b3af3 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:12.778331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1092/2214] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:12 2022] POST /identity/v3/users => generated 295 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:12.792559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cfb30-c549-4639-aa5b-1a5b9d8b3af3 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:12.805815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32b85-d9eb-47a9-941f-f760f957312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:12.806876 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32b85-d9eb-47a9-941f-f760f957312e admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:12.807163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32b85-d9eb-47a9-941f-f760f957312e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:12.807639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32b85-d9eb-47a9-941f-f760f957312e admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:12.809180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c32b85-d9eb-47a9-941f-f760f957312e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:12.811702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c32b85-d9eb-47a9-941f-f760f957312e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:12.830794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1123/2215] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:12.835005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef748b7-71fd-497d-aef0-23dbb421a7ea admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:12.846353 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef748b7-71fd-497d-aef0-23dbb421a7ea admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:12.852606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d3df-1c27-4cd5-8ee0-fc2204a7c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:12.853530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d3df-1c27-4cd5-8ee0-fc2204a7c605 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:12.853960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d3df-1c27-4cd5-8ee0-fc2204a7c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:12.854394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d3df-1c27-4cd5-8ee0-fc2204a7c605 admin admin] PATH_INFO: `/v3/projects/a49fb1b7e74044cb8ca0ec000075d51e/users/2ca7e3edcb034bb8bfe0682d701ab63a/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:12.885515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9d3df-1c27-4cd5-8ee0-fc2204a7c605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49fb1b7e74044cb8ca0ec000075d51e, user_id=2ca7e3edcb034bb8bfe0682d701ab63a, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:12.888269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9d3df-1c27-4cd5-8ee0-fc2204a7c605 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:12.942875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaab9e-96e6-4786-8634-26bb1585ef58 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:12.943246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaab9e-96e6-4786-8634-26bb1585ef58 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:12.943461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaab9e-96e6-4786-8634-26bb1585ef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:13.001575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1093/2216] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:12 2022] PUT /identity/v3/projects/a49fb1b7e74044cb8ca0ec000075d51e/users/2ca7e3edcb034bb8bfe0682d701ab63a/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:13.006542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d3df-1c27-4cd5-8ee0-fc2204a7c605 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:13.019941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-beeaab9e-96e6-4786-8634-26bb1585ef58 None None] MFA Rules not processed for user `601dc79382404e90a6acd32d118d13a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:13.022184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-beeaab9e-96e6-4786-8634-26bb1585ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:13.181337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d3df-1c27-4cd5-8ee0-fc2204a7c605 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:13.193944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356735dc-97a7-4aef-9d44-0835d2976be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:13.209931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356735dc-97a7-4aef-9d44-0835d2976be5 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:13.211036 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356735dc-97a7-4aef-9d44-0835d2976be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:13.212125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356735dc-97a7-4aef-9d44-0835d2976be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:13.213956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356735dc-97a7-4aef-9d44-0835d2976be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:13.215673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356735dc-97a7-4aef-9d44-0835d2976be5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:13.244895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1094/2217] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:13.245952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356735dc-97a7-4aef-9d44-0835d2976be5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:13.254785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1124/2218] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:13.270805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaab9e-96e6-4786-8634-26bb1585ef58 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:13.273740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-beeaab9e-96e6-4786-8634-26bb1585ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:13.283738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356735dc-97a7-4aef-9d44-0835d2976be5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:13.295900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c5747-9abb-41ba-8c39-c1d818f6676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:13.296587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c5747-9abb-41ba-8c39-c1d818f6676e admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:13.296890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c5747-9abb-41ba-8c39-c1d818f6676e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:13.297349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c5747-9abb-41ba-8c39-c1d818f6676e admin admin] PATH_INFO: `/v3/projects/a49fb1b7e74044cb8ca0ec000075d51e/users/2ca7e3edcb034bb8bfe0682d701ab63a/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:13.302425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c5747-9abb-41ba-8c39-c1d818f6676e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49fb1b7e74044cb8ca0ec000075d51e, user_id=2ca7e3edcb034bb8bfe0682d701ab63a, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:13.305215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c5747-9abb-41ba-8c39-c1d818f6676e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:13.327071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1095/2219] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:13 2022] PUT /identity/v3/projects/a49fb1b7e74044cb8ca0ec000075d51e/users/2ca7e3edcb034bb8bfe0682d701ab63a/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:13.346022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29470a16-f7cd-4776-afb8-d5d792c6acc7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:13.346685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29470a16-f7cd-4776-afb8-d5d792c6acc7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:13.347184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29470a16-f7cd-4776-afb8-d5d792c6acc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:13.372992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:13.404668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-29470a16-f7cd-4776-afb8-d5d792c6acc7 None None] MFA Rules not processed for user `2ca7e3edcb034bb8bfe0682d701ab63a`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:13.406306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-29470a16-f7cd-4776-afb8-d5d792c6acc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:13.455920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaab9e-96e6-4786-8634-26bb1585ef58 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:13.552440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1096/2220] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:13.567505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29470a16-f7cd-4776-afb8-d5d792c6acc7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:13.568795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-29470a16-f7cd-4776-afb8-d5d792c6acc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:13.593855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ab3e-b59d-475c-b787-00775c278766 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:13.594473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ab3e-b59d-475c-b787-00775c278766 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:13.594769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ab3e-b59d-475c-b787-00775c278766 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:13.595060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ab3e-b59d-475c-b787-00775c278766 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:13.674493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29470a16-f7cd-4776-afb8-d5d792c6acc7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:13.679155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07492a-aa20-4685-adac-35d6e9a1f4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:13.679808 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07492a-aa20-4685-adac-35d6e9a1f4bf service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:13.680090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07492a-aa20-4685-adac-35d6e9a1f4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:13.680363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07492a-aa20-4685-adac-35d6e9a1f4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:13.701326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7ab3e-b59d-475c-b787-00775c278766 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:13.702954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7ab3e-b59d-475c-b787-00775c278766 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:13.713441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1125/2221] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:13.772556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07492a-aa20-4685-adac-35d6e9a1f4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:13.774902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07492a-aa20-4685-adac-35d6e9a1f4bf service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:13.796304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1097/2222] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:56:13.900163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:13.955948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:14.265295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a5b27-c20c-4521-8587-8a2133ac7973 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:14.268240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a5b27-c20c-4521-8587-8a2133ac7973 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:14.268240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a5b27-c20c-4521-8587-8a2133ac7973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:14.316299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ee9a5b27-c20c-4521-8587-8a2133ac7973 None None] MFA Rules not processed for user `6c2704c142f54c9e8e1058ff8111bb83`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:14.318215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ee9a5b27-c20c-4521-8587-8a2133ac7973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:14.486787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1126/2223] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:14.492241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07492a-aa20-4685-adac-35d6e9a1f4bf service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:14.493875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5b07492a-aa20-4685-adac-35d6e9a1f4bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:14.600997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07492a-aa20-4685-adac-35d6e9a1f4bf service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:14.606817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b3eef-eed5-46ab-8490-99f706a4d443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:14.607645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b3eef-eed5-46ab-8490-99f706a4d443 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:14.608031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b3eef-eed5-46ab-8490-99f706a4d443 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:14.608552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b3eef-eed5-46ab-8490-99f706a4d443 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:14.609390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b3eef-eed5-46ab-8490-99f706a4d443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:14.612033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b3eef-eed5-46ab-8490-99f706a4d443 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:14.707200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1098/2224] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:14 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:14.709579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a5b27-c20c-4521-8587-8a2133ac7973 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:14.727816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a5b27-c20c-4521-8587-8a2133ac7973 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:14.911830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8eff-94ea-468e-aa0c-573581d8a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:14.912632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8eff-94ea-468e-aa0c-573581d8a4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:14.913353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8eff-94ea-468e-aa0c-573581d8a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:14.913353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8eff-94ea-468e-aa0c-573581d8a4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:14.914927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c8eff-94ea-468e-aa0c-573581d8a4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:14.917873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c8eff-94ea-468e-aa0c-573581d8a4c8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:15.105533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1127/2225] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:14 2022] POST /identity/v3/users => generated 293 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:15.109166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b3eef-eed5-46ab-8490-99f706a4d443 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:15.126903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b3eef-eed5-46ab-8490-99f706a4d443 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:15.139538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c6da2-c408-4087-b96b-0049fde57702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:15.141145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c6da2-c408-4087-b96b-0049fde57702 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:15.141490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c6da2-c408-4087-b96b-0049fde57702 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:15.143851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c6da2-c408-4087-b96b-0049fde57702 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:15.143851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c6da2-c408-4087-b96b-0049fde57702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:15.145750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c6da2-c408-4087-b96b-0049fde57702 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:15.172582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1099/2226] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:15.173315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8eff-94ea-468e-aa0c-573581d8a4c8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:15.195504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8eff-94ea-468e-aa0c-573581d8a4c8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:15.211504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c4e5f-9085-4b72-b195-8829e094d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:15.213300 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c4e5f-9085-4b72-b195-8829e094d5d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:15.214021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c4e5f-9085-4b72-b195-8829e094d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:15.214208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c4e5f-9085-4b72-b195-8829e094d5d4 admin admin] PATH_INFO: `/v3/projects/b6353dd873b942c196c53e11e050fce8/users/75eedd163cb24fb8a05dbbb9efdd6102/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:15.247052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c4e5f-9085-4b72-b195-8829e094d5d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6353dd873b942c196c53e11e050fce8, user_id=75eedd163cb24fb8a05dbbb9efdd6102, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:15.250611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c4e5f-9085-4b72-b195-8829e094d5d4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:15.367986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1128/2227] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:15 2022] PUT /identity/v3/projects/b6353dd873b942c196c53e11e050fce8/users/75eedd163cb24fb8a05dbbb9efdd6102/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:15.371712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c6da2-c408-4087-b96b-0049fde57702 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:15.389240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c6da2-c408-4087-b96b-0049fde57702 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:15.483752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a0ff6-ab15-4cf4-8d8b-9358de509e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:15.484717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a0ff6-ab15-4cf4-8d8b-9358de509e0f admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:15.485146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a0ff6-ab15-4cf4-8d8b-9358de509e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:15.485590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a0ff6-ab15-4cf4-8d8b-9358de509e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:15.486852 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a0ff6-ab15-4cf4-8d8b-9358de509e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:15.489484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a0ff6-ab15-4cf4-8d8b-9358de509e0f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:15.503665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1100/2228] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:15.509555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c4e5f-9085-4b72-b195-8829e094d5d4 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:15.521243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c4e5f-9085-4b72-b195-8829e094d5d4 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:15.538323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547c12-7669-4b1d-b2c6-9cf665d90fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:15.539374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547c12-7669-4b1d-b2c6-9cf665d90fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:15.539799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547c12-7669-4b1d-b2c6-9cf665d90fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:15.540372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547c12-7669-4b1d-b2c6-9cf665d90fd1 admin admin] PATH_INFO: `/v3/projects/b6353dd873b942c196c53e11e050fce8/users/75eedd163cb24fb8a05dbbb9efdd6102/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:15.543134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0547c12-7669-4b1d-b2c6-9cf665d90fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6353dd873b942c196c53e11e050fce8, user_id=75eedd163cb24fb8a05dbbb9efdd6102, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:15.546049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0547c12-7669-4b1d-b2c6-9cf665d90fd1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:15.567085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1129/2229] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:15 2022] PUT /identity/v3/projects/b6353dd873b942c196c53e11e050fce8/users/75eedd163cb24fb8a05dbbb9efdd6102/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:16.488377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:16.551926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:16.953868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a0ff6-ab15-4cf4-8d8b-9358de509e0f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:17.016286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547c12-7669-4b1d-b2c6-9cf665d90fd1 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:17.025257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c0547c12-7669-4b1d-b2c6-9cf665d90fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:17.213715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a0ff6-ab15-4cf4-8d8b-9358de509e0f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:17.218125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10689c41-462d-4db5-a4a3-80b4fe910314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:17.223071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689c41-462d-4db5-a4a3-80b4fe910314 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:17.223714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689c41-462d-4db5-a4a3-80b4fe910314 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:17.224169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10689c41-462d-4db5-a4a3-80b4fe910314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:17.226856 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547c12-7669-4b1d-b2c6-9cf665d90fd1 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:17.232060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddd7ac-72d3-49ee-acfe-5e84e9d91d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:17.232900 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddd7ac-72d3-49ee-acfe-5e84e9d91d06 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:17.233323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddd7ac-72d3-49ee-acfe-5e84e9d91d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:17.233836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddd7ac-72d3-49ee-acfe-5e84e9d91d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:17.237089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-53ddd7ac-72d3-49ee-acfe-5e84e9d91d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:17.404360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10689c41-462d-4db5-a4a3-80b4fe910314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:17.410026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10689c41-462d-4db5-a4a3-80b4fe910314 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:17.435163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1101/2230] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:17.436014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddd7ac-72d3-49ee-acfe-5e84e9d91d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:17.437785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddd7ac-72d3-49ee-acfe-5e84e9d91d06 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:17.461244 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1130/2231] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:17.727092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:18.038876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4abb6-7216-47e4-b06e-460bbb119862 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:18.039552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4abb6-7216-47e4-b06e-460bbb119862 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:18.039552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4abb6-7216-47e4-b06e-460bbb119862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:18.058818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-9fc4abb6-7216-47e4-b06e-460bbb119862 None None] MFA Rules not processed for user `601dc79382404e90a6acd32d118d13a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:18.060057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9fc4abb6-7216-47e4-b06e-460bbb119862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:18.120657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1102/2232] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:18.373285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:19.591536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:20.886645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=82,keystone:DELETE=12,keystone:INSERT=6 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:22.321554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:22.681847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebd307-6946-4865-9485-006b21a06954 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:22.682512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebd307-6946-4865-9485-006b21a06954 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:22.682945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebd307-6946-4865-9485-006b21a06954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:22.712037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-5aebd307-6946-4865-9485-006b21a06954 None None] MFA Rules not processed for user `9d544d38a5664f68bff83e6c9798ffd9`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:22.713293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5aebd307-6946-4865-9485-006b21a06954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:22.807698 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1131/2233] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:23.003741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:23.158007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:23.484888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4abb6-7216-47e4-b06e-460bbb119862 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:23.562051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4abb6-7216-47e4-b06e-460bbb119862 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:23.570175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:23.571080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:23.571695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:23.571973 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] PATH_INFO: `/v3/users/aefeb7f64c144a4f8583d114f614e915` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:23.573132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefeb7f64c144a4f8583d114f614e915)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:23.575347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:23.847565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefeb7f64c144a4f8583d114f614e915'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:23.849362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefeb7f64c144a4f8583d114f614e915'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:23.850400 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefeb7f64c144a4f8583d114f614e915'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:23.873006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefeb7f64c144a4f8583d114f614e915'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:23.977889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefeb7f64c144a4f8583d114f614e915'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:24.016344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1103/2234] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:23 2022] DELETE /identity/v3/users/aefeb7f64c144a4f8583d114f614e915 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:24.018337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa6ab0-a8b6-4b15-a4cd-99ec3fab07b9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:24.018997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa6ab0-a8b6-4b15-a4cd-99ec3fab07b9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:24.019133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa6ab0-a8b6-4b15-a4cd-99ec3fab07b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:24.056286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c1aa6ab0-a8b6-4b15-a4cd-99ec3fab07b9 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:24.057623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c1aa6ab0-a8b6-4b15-a4cd-99ec3fab07b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:24.175272 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1132/2235] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:24.183961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:24.188982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:24.302695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b261a5-7faf-45a6-846d-8318003d351a admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:24.307526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8bf98-1852-418e-972c-3318bd3bf7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:24.308228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8bf98-1852-418e-972c-3318bd3bf7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:24.308440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8bf98-1852-418e-972c-3318bd3bf7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:24.308710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8bf98-1852-418e-972c-3318bd3bf7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:24.323768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8bf98-1852-418e-972c-3318bd3bf7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:24.325217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8bf98-1852-418e-972c-3318bd3bf7c1 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:24.346190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1104/2236] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:24.526007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa6ab0-a8b6-4b15-a4cd-99ec3fab07b9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:24.578016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c1aa6ab0-a8b6-4b15-a4cd-99ec3fab07b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:24.578016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa6ab0-a8b6-4b15-a4cd-99ec3fab07b9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:24.578016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:24.578757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:24.578757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:24.578757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] PATH_INFO: `/v3/users/5b6cee4e59bb4d13830f10797aed4157` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:24.578757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6cee4e59bb4d13830f10797aed4157)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:24.578757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:24.883012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6cee4e59bb4d13830f10797aed4157'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:24.884468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6cee4e59bb4d13830f10797aed4157'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:24.886321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6cee4e59bb4d13830f10797aed4157'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:24.988326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6cee4e59bb4d13830f10797aed4157'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:25.036868 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6cee4e59bb4d13830f10797aed4157'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:25.068975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1133/2237] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:24 2022] DELETE /identity/v3/users/5b6cee4e59bb4d13830f10797aed4157 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:25.073174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e12172-a610-4c8c-b492-bf4ec7624039 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:25.073475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e12172-a610-4c8c-b492-bf4ec7624039 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:25.073720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e12172-a610-4c8c-b492-bf4ec7624039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:25.171818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-b1e12172-a610-4c8c-b492-bf4ec7624039 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:25.171818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b1e12172-a610-4c8c-b492-bf4ec7624039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:25.280595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1105/2238] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:25.292770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:25.295168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:25.440575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d348c-112b-4b65-855b-c670e7c1e8ac admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:25.449175 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e2d0d-c0f2-4f2b-a099-33c08442b722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:25.449854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e2d0d-c0f2-4f2b-a099-33c08442b722 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:25.450415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e2d0d-c0f2-4f2b-a099-33c08442b722 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:25.450533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e2d0d-c0f2-4f2b-a099-33c08442b722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:25.472235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e2d0d-c0f2-4f2b-a099-33c08442b722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:25.472635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e2d0d-c0f2-4f2b-a099-33c08442b722 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:25.495828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1134/2239] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:56:25.650418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa41ad-f978-49e3-a324-b9a5462bbd64 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:25.650763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa41ad-f978-49e3-a324-b9a5462bbd64 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:25.651038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa41ad-f978-49e3-a324-b9a5462bbd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:25.700450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-5baa41ad-f978-49e3-a324-b9a5462bbd64 None None] MFA Rules not processed for user `75eedd163cb24fb8a05dbbb9efdd6102`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:25.703855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5baa41ad-f978-49e3-a324-b9a5462bbd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:25.775535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e2d0d-c0f2-4f2b-a099-33c08442b722 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:25.778033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-013e2d0d-c0f2-4f2b-a099-33c08442b722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:25.802369 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e2d0d-c0f2-4f2b-a099-33c08442b722 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:25.814356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:25.815778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:25.817946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:25.818331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] PATH_INFO: `/v3/projects/e76cc88296c44fe7a6c8e8c96f3a1157` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:25.822250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76cc88296c44fe7a6c8e8c96f3a1157)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:25.828504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:25.835627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1106/2240] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:25.852599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa41ad-f978-49e3-a324-b9a5462bbd64 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:25.854206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5baa41ad-f978-49e3-a324-b9a5462bbd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:25.865064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:25.898647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:26.000245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa41ad-f978-49e3-a324-b9a5462bbd64 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:26.018137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76cc88296c44fe7a6c8e8c96f3a1157', 'request_id': 'req-c515f1fe-8ffd-4d09-ba31-697841a32f2b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.026263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76cc88296c44fe7a6c8e8c96f3a1157', 'request_id': 'req-c515f1fe-8ffd-4d09-ba31-697841a32f2b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.070452 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:26.071128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:26.071441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:26.071718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:26.073641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:26.120927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76cc88296c44fe7a6c8e8c96f3a1157', 'request_id': 'req-c515f1fe-8ffd-4d09-ba31-697841a32f2b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.134431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] The token cache is being invalidate because project e76cc88296c44fe7a6c8e8c96f3a1157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:26.134984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.135980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.137921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1135/2241] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:25 2022] DELETE /identity/v3/projects/e76cc88296c44fe7a6c8e8c96f3a1157 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:26.141709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:26.143732 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:26.144992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:26.146606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:26.157301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1107/2242] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:26.202968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:26.205090 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:26.263048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515f1fe-8ffd-4d09-ba31-697841a32f2b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:26.278624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:26.279578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:26.280013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:26.280482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] PATH_INFO: `/v3/users/2ca7e3edcb034bb8bfe0682d701ab63a` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:26.282799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca7e3edcb034bb8bfe0682d701ab63a)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:26.285135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:26.335762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770df400-1ab0-48ac-8414-4b736d5af8a7 service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:26.348997 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:26.349750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:26.350035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:26.350305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] PATH_INFO: `/v3/projects/263dc6bf7beb4b56831f72090334988d` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:26.351657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263dc6bf7beb4b56831f72090334988d)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:26.363537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:26.534927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca7e3edcb034bb8bfe0682d701ab63a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.535664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca7e3edcb034bb8bfe0682d701ab63a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.539466 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca7e3edcb034bb8bfe0682d701ab63a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.547158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263dc6bf7beb4b56831f72090334988d', 'request_id': 'req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.631839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca7e3edcb034bb8bfe0682d701ab63a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.652500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca7e3edcb034bb8bfe0682d701ab63a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.680284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1136/2243] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:26 2022] DELETE /identity/v3/users/2ca7e3edcb034bb8bfe0682d701ab63a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:26.717271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:26.780795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263dc6bf7beb4b56831f72090334988d', 'request_id': 'req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.793233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263dc6bf7beb4b56831f72090334988d', 'request_id': 'req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.809238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] The token cache is being invalidate because project 263dc6bf7beb4b56831f72090334988d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:26.809913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.810729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:26.813498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1108/2244] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:26 2022] DELETE /identity/v3/projects/263dc6bf7beb4b56831f72090334988d => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:26.818636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:26.820884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:26.960043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53360fe-8554-49a1-ad75-ac5102c99883 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:26.967192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:26.967962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:26.968243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:26.968517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] PATH_INFO: `/v3/users/ebc9748f47c94de5bcda16cc7b2b9f8a` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:26.972597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc9748f47c94de5bcda16cc7b2b9f8a)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:26.972597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:27.231397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc9748f47c94de5bcda16cc7b2b9f8a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:27.232253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc9748f47c94de5bcda16cc7b2b9f8a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:27.233948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc9748f47c94de5bcda16cc7b2b9f8a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:27.298059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc9748f47c94de5bcda16cc7b2b9f8a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:27.314652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-da637f3e-3d37-4ee5-b384-6e11ba8a7e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc9748f47c94de5bcda16cc7b2b9f8a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:27.329690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1137/2245] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:26 2022] DELETE /identity/v3/users/ebc9748f47c94de5bcda16cc7b2b9f8a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:27.593140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:27.597099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:27.712276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713ecd1-dca9-44b1-a138-95f5b67f9bc4 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:27.834758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:27.837325 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:27.837713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:27.838298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] PATH_INFO: `/v3/projects/a49fb1b7e74044cb8ca0ec000075d51e` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:27.839784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49fb1b7e74044cb8ca0ec000075d51e)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:27.842406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:28.002039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49fb1b7e74044cb8ca0ec000075d51e', 'request_id': 'req-1e531646-83ce-4d2c-be3d-e08bc68e68d5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.132608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49fb1b7e74044cb8ca0ec000075d51e', 'request_id': 'req-1e531646-83ce-4d2c-be3d-e08bc68e68d5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.139600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49fb1b7e74044cb8ca0ec000075d51e', 'request_id': 'req-1e531646-83ce-4d2c-be3d-e08bc68e68d5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.150779 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] The token cache is being invalidate because project a49fb1b7e74044cb8ca0ec000075d51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:28.151072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.151760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.153279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1109/2246] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:27 2022] DELETE /identity/v3/projects/a49fb1b7e74044cb8ca0ec000075d51e => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:28.158191 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f00ac9-83b5-41d0-b09f-89bea2151975 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.158508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f00ac9-83b5-41d0-b09f-89bea2151975 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.159389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f00ac9-83b5-41d0-b09f-89bea2151975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.184952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e7f00ac9-83b5-41d0-b09f-89bea2151975 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:28.187267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e7f00ac9-83b5-41d0-b09f-89bea2151975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:28.234845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:28.240558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:28.281206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1138/2247] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:28.291252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc01da-226c-4cb1-9942-035e61f52b5d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.291754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc01da-226c-4cb1-9942-035e61f52b5d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.292207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc01da-226c-4cb1-9942-035e61f52b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.349184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-96bc01da-226c-4cb1-9942-035e61f52b5d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:28.350320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-96bc01da-226c-4cb1-9942-035e61f52b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:28.356574 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e531646-83ce-4d2c-be3d-e08bc68e68d5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:28.364748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:28.365463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.365750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.366035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] PATH_INFO: `/v3/projects/442cb23184124a318fb45b204afd6794` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.367350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=442cb23184124a318fb45b204afd6794)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:28.369356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:28.372640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:28.375715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1139/2248] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:28.380715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc01da-226c-4cb1-9942-035e61f52b5d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:28.391101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc01da-226c-4cb1-9942-035e61f52b5d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:28.396567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919307-c49c-47bf-ad59-f5e98229b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:28.397181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919307-c49c-47bf-ad59-f5e98229b9bc admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.397600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919307-c49c-47bf-ad59-f5e98229b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.397766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919307-c49c-47bf-ad59-f5e98229b9bc admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.398424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a919307-c49c-47bf-ad59-f5e98229b9bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:56:28.398737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a919307-c49c-47bf-ad59-f5e98229b9bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:28.400535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a919307-c49c-47bf-ad59-f5e98229b9bc admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:28.421578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1140/2249] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:56:28.427035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919307-c49c-47bf-ad59-f5e98229b9bc admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:28.458494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919307-c49c-47bf-ad59-f5e98229b9bc admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:28.474069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22e4b4-eb8f-4b04-ba74-c3e56d8d99ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:28.474913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22e4b4-eb8f-4b04-ba74-c3e56d8d99ee admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.476049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22e4b4-eb8f-4b04-ba74-c3e56d8d99ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.476504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22e4b4-eb8f-4b04-ba74-c3e56d8d99ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.477156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22e4b4-eb8f-4b04-ba74-c3e56d8d99ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:28.479109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22e4b4-eb8f-4b04-ba74-c3e56d8d99ee admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:28.527031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442cb23184124a318fb45b204afd6794', 'request_id': 'req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.634949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442cb23184124a318fb45b204afd6794', 'request_id': 'req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.643029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442cb23184124a318fb45b204afd6794', 'request_id': 'req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.646549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1141/2250] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:28 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:28.650886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22e4b4-eb8f-4b04-ba74-c3e56d8d99ee admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:28.680077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] The token cache is being invalidate because project 442cb23184124a318fb45b204afd6794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:28.680077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.680077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f955555d-6bd2-4f4a-adc8-6df4970ccc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:28.682740 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1110/2251] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:28 2022] DELETE /identity/v3/projects/442cb23184124a318fb45b204afd6794 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:28.688516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8182-1b49-454c-a2f0-c7b82b1088f8 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.688943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8182-1b49-454c-a2f0-c7b82b1088f8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.690684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8182-1b49-454c-a2f0-c7b82b1088f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.738834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3d2e8182-1b49-454c-a2f0-c7b82b1088f8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:28.741489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3d2e8182-1b49-454c-a2f0-c7b82b1088f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:28.775549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22e4b4-eb8f-4b04-ba74-c3e56d8d99ee admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:28.781360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7413b-04e7-40d7-9034-59db7df308fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:28.782894 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7413b-04e7-40d7-9034-59db7df308fd admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.783449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7413b-04e7-40d7-9034-59db7df308fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.784665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7413b-04e7-40d7-9034-59db7df308fd admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.785310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7413b-04e7-40d7-9034-59db7df308fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:28.787578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7413b-04e7-40d7-9034-59db7df308fd admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:28.823749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1111/2252] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:28.827579 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ca3fe-a947-46aa-8bf5-2007667851d5 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.827802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ca3fe-a947-46aa-8bf5-2007667851d5 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.828051 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ca3fe-a947-46aa-8bf5-2007667851d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.850078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-846ca3fe-a947-46aa-8bf5-2007667851d5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:28.851346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-846ca3fe-a947-46aa-8bf5-2007667851d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:28.860350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1112/2253] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:28.865197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ca3fe-a947-46aa-8bf5-2007667851d5 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:28.880849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ca3fe-a947-46aa-8bf5-2007667851d5 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:28.886759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72766b1a-3975-4612-bdb0-f62d6ed22e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:28.887817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1142/2254] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:28 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:28.888751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7413b-04e7-40d7-9034-59db7df308fd admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:28.888857 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72766b1a-3975-4612-bdb0-f62d6ed22e26 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.889215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72766b1a-3975-4612-bdb0-f62d6ed22e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.889609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72766b1a-3975-4612-bdb0-f62d6ed22e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.890408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72766b1a-3975-4612-bdb0-f62d6ed22e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:56:28.890813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72766b1a-3975-4612-bdb0-f62d6ed22e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:28.890998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a7a7413b-04e7-40d7-9034-59db7df308fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:28.892481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72766b1a-3975-4612-bdb0-f62d6ed22e26 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:28.906183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1113/2255] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:56:28.910538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7413b-04e7-40d7-9034-59db7df308fd admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:28.911643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72766b1a-3975-4612-bdb0-f62d6ed22e26 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:28.920990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753e970-e455-4f7f-b0cd-b4175f684705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:28.926777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e970-e455-4f7f-b0cd-b4175f684705 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.926777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e970-e455-4f7f-b0cd-b4175f684705 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.926777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e970-e455-4f7f-b0cd-b4175f684705 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.926777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753e970-e455-4f7f-b0cd-b4175f684705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:28.927423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72766b1a-3975-4612-bdb0-f62d6ed22e26 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:28.927505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753e970-e455-4f7f-b0cd-b4175f684705 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:28.930348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c865ca-d483-4859-8ba6-a5405ed1cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:28.931952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c865ca-d483-4859-8ba6-a5405ed1cb8f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.932391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c865ca-d483-4859-8ba6-a5405ed1cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.932817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c865ca-d483-4859-8ba6-a5405ed1cb8f admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.933601 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c865ca-d483-4859-8ba6-a5405ed1cb8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:28.935747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c865ca-d483-4859-8ba6-a5405ed1cb8f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:28.937799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1143/2256] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:28.942105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753e970-e455-4f7f-b0cd-b4175f684705 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:28.970397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753e970-e455-4f7f-b0cd-b4175f684705 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:28.985616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92680583-99b2-43c2-bc71-96bc0488eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:28.987896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92680583-99b2-43c2-bc71-96bc0488eb2d admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.988194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92680583-99b2-43c2-bc71-96bc0488eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.988738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92680583-99b2-43c2-bc71-96bc0488eb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.000769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92680583-99b2-43c2-bc71-96bc0488eb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.003071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92680583-99b2-43c2-bc71-96bc0488eb2d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.006228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1114/2257] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:28 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:29.010040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c865ca-d483-4859-8ba6-a5405ed1cb8f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.024690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1144/2258] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:29.029142 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92680583-99b2-43c2-bc71-96bc0488eb2d admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.056432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92680583-99b2-43c2-bc71-96bc0488eb2d admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.082462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c865ca-d483-4859-8ba6-a5405ed1cb8f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.091050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3bc35-5c2a-476a-9aa8-5a3719d9ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.093020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3bc35-5c2a-476a-9aa8-5a3719d9ee61 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.093020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3bc35-5c2a-476a-9aa8-5a3719d9ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.093020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3bc35-5c2a-476a-9aa8-5a3719d9ee61 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.094800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3bc35-5c2a-476a-9aa8-5a3719d9ee61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.097825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3bc35-5c2a-476a-9aa8-5a3719d9ee61 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.144505 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c246-2ba4-4b4d-82f9-8deee1a9f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.145126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c246-2ba4-4b4d-82f9-8deee1a9f3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.145409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c246-2ba4-4b4d-82f9-8deee1a9f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.145840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c246-2ba4-4b4d-82f9-8deee1a9f3ed admin admin] PATH_INFO: `/v3/projects/ea0969492cf84bfba662def333bcea1e/users/1ae7b4e8f73d400ca6464334889d0792/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.168950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c246-2ba4-4b4d-82f9-8deee1a9f3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0969492cf84bfba662def333bcea1e, user_id=1ae7b4e8f73d400ca6464334889d0792, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.171946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c246-2ba4-4b4d-82f9-8deee1a9f3ed admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.198428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1115/2259] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:29 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:29.204172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3bc35-5c2a-476a-9aa8-5a3719d9ee61 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.211689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:29.221002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3bc35-5c2a-476a-9aa8-5a3719d9ee61 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.226856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90c40-e690-4bfa-a784-4dc52d227e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.227688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90c40-e690-4bfa-a784-4dc52d227e04 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.227965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90c40-e690-4bfa-a784-4dc52d227e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.228237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90c40-e690-4bfa-a784-4dc52d227e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.228888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac90c40-e690-4bfa-a784-4dc52d227e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.230481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac90c40-e690-4bfa-a784-4dc52d227e04 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.243406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1116/2260] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:56:29.247798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90c40-e690-4bfa-a784-4dc52d227e04 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.253289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1145/2261] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:29 2022] PUT /identity/v3/projects/ea0969492cf84bfba662def333bcea1e/users/1ae7b4e8f73d400ca6464334889d0792/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:29.258753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90c40-e690-4bfa-a784-4dc52d227e04 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.263841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ca3f-c57c-42bc-9a6c-426878ec02e1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.264127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ca3f-c57c-42bc-9a6c-426878ec02e1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.264413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ca3f-c57c-42bc-9a6c-426878ec02e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.295916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c885ca3f-c57c-42bc-9a6c-426878ec02e1 None None] MFA Rules not processed for user `1ae7b4e8f73d400ca6464334889d0792`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:29.297429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c885ca3f-c57c-42bc-9a6c-426878ec02e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:29.330233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6e414-faf1-44e3-82a8-5f554c559432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.331978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e414-faf1-44e3-82a8-5f554c559432 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.332416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e414-faf1-44e3-82a8-5f554c559432 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.332868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6e414-faf1-44e3-82a8-5f554c559432 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.333724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6e414-faf1-44e3-82a8-5f554c559432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.335568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6e414-faf1-44e3-82a8-5f554c559432 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.349799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1117/2262] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:29.355029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6e414-faf1-44e3-82a8-5f554c559432 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.377477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6e414-faf1-44e3-82a8-5f554c559432 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.384509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09464bd-023d-4f12-b60b-e08b6692d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.385239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09464bd-023d-4f12-b60b-e08b6692d323 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.385627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09464bd-023d-4f12-b60b-e08b6692d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.387071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09464bd-023d-4f12-b60b-e08b6692d323 admin admin] PATH_INFO: `/v3/projects/43e36db46bf24c6891e4e2a63b29a609/users/1975c7ea12444fafada39fb5233e3982/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.392536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1146/2263] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:29.397824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885ca3f-c57c-42bc-9a6c-426878ec02e1 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.406831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09464bd-023d-4f12-b60b-e08b6692d323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e36db46bf24c6891e4e2a63b29a609, user_id=1975c7ea12444fafada39fb5233e3982, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.411014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09464bd-023d-4f12-b60b-e08b6692d323 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.412937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885ca3f-c57c-42bc-9a6c-426878ec02e1 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.419325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a6978-53b6-4353-91fc-16b7937fb1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.420294 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a6978-53b6-4353-91fc-16b7937fb1cc admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.420776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a6978-53b6-4353-91fc-16b7937fb1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.421194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a6978-53b6-4353-91fc-16b7937fb1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.422044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a6978-53b6-4353-91fc-16b7937fb1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.424903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a6978-53b6-4353-91fc-16b7937fb1cc admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.530569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1118/2264] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:29 2022] PUT /identity/v3/projects/43e36db46bf24c6891e4e2a63b29a609/users/1975c7ea12444fafada39fb5233e3982/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:29.541129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ff19-ca68-42a3-8a5d-f981a88214e0 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.541484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1147/2265] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:29 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:29.541693 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ff19-ca68-42a3-8a5d-f981a88214e0 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.542225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ff19-ca68-42a3-8a5d-f981a88214e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.545459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a6978-53b6-4353-91fc-16b7937fb1cc admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.583609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-27b0ff19-ca68-42a3-8a5d-f981a88214e0 None None] MFA Rules not processed for user `1975c7ea12444fafada39fb5233e3982`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:29.584841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-27b0ff19-ca68-42a3-8a5d-f981a88214e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:29.592358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:29.641314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a6978-53b6-4353-91fc-16b7937fb1cc admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.647104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c5cc-bc9a-40b5-b806-aefcfbd5c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.654212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c5cc-bc9a-40b5-b806-aefcfbd5c2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.654503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c5cc-bc9a-40b5-b806-aefcfbd5c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.654896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c5cc-bc9a-40b5-b806-aefcfbd5c2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.655660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976c5cc-bc9a-40b5-b806-aefcfbd5c2b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.657833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976c5cc-bc9a-40b5-b806-aefcfbd5c2b2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.682296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1119/2266] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:29.688481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0ff19-ca68-42a3-8a5d-f981a88214e0 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.703123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0ff19-ca68-42a3-8a5d-f981a88214e0 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.708284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6ac7a-ad07-460c-aa9e-4b5893ab3f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.708903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ac7a-ad07-460c-aa9e-4b5893ab3f86 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.709186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ac7a-ad07-460c-aa9e-4b5893ab3f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.709456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ac7a-ad07-460c-aa9e-4b5893ab3f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.710124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6ac7a-ad07-460c-aa9e-4b5893ab3f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.712089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6ac7a-ad07-460c-aa9e-4b5893ab3f86 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.763337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1148/2267] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:29 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:29.765896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c5cc-bc9a-40b5-b806-aefcfbd5c2b2 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.780685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c5cc-bc9a-40b5-b806-aefcfbd5c2b2 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.788421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320f896-8a53-42c6-94df-11594c2b5066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.789233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f896-8a53-42c6-94df-11594c2b5066 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.790385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f896-8a53-42c6-94df-11594c2b5066 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.790385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f896-8a53-42c6-94df-11594c2b5066 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.790649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320f896-8a53-42c6-94df-11594c2b5066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.792533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320f896-8a53-42c6-94df-11594c2b5066 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.810439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1149/2268] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:56:29.811774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320f896-8a53-42c6-94df-11594c2b5066 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.825092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320f896-8a53-42c6-94df-11594c2b5066 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.829325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4eacf-91ca-44a6-b8f4-925039d5c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.829961 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4eacf-91ca-44a6-b8f4-925039d5c571 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.830243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4eacf-91ca-44a6-b8f4-925039d5c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.833555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4eacf-91ca-44a6-b8f4-925039d5c571 admin admin] PATH_INFO: `/v3/projects/7379099e2373497885a354a670c5c3f7/users/0276fc4e0b394b4182f6f034ea0edd36/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.850467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4eacf-91ca-44a6-b8f4-925039d5c571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7379099e2373497885a354a670c5c3f7, user_id=0276fc4e0b394b4182f6f034ea0edd36, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.853485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4eacf-91ca-44a6-b8f4-925039d5c571 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.867369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1120/2269] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:29 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:29.871354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6ac7a-ad07-460c-aa9e-4b5893ab3f86 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:29.944349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6ac7a-ad07-460c-aa9e-4b5893ab3f86 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:29.950080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e01dd-d55f-421b-ad6b-5d5b9abe3ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:29.950692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e01dd-d55f-421b-ad6b-5d5b9abe3ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.950980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e01dd-d55f-421b-ad6b-5d5b9abe3ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.951251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e01dd-d55f-421b-ad6b-5d5b9abe3ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.951971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e01dd-d55f-421b-ad6b-5d5b9abe3ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:29.953944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e01dd-d55f-421b-ad6b-5d5b9abe3ff5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:29.967543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1150/2270] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:29 2022] PUT /identity/v3/projects/7379099e2373497885a354a670c5c3f7/users/0276fc4e0b394b4182f6f034ea0edd36/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:29.972615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4eacf-91ca-44a6-b8f4-925039d5c571 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.043390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4eacf-91ca-44a6-b8f4-925039d5c571 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:30.049664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278f319-e174-49b2-9d9e-3e226d620c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:30.050855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278f319-e174-49b2-9d9e-3e226d620c06 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.051365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278f319-e174-49b2-9d9e-3e226d620c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.051646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278f319-e174-49b2-9d9e-3e226d620c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.052301 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278f319-e174-49b2-9d9e-3e226d620c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:30.054673 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278f319-e174-49b2-9d9e-3e226d620c06 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:30.073387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1151/2271] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:56:30.078151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1121/2272] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:29 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:30.078324 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278f319-e174-49b2-9d9e-3e226d620c06 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.079442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e01dd-d55f-421b-ad6b-5d5b9abe3ff5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.087883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278f319-e174-49b2-9d9e-3e226d620c06 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:30.091111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e01dd-d55f-421b-ad6b-5d5b9abe3ff5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:30.093488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25649d-72f6-49b6-ba91-f21150946d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:30.094291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25649d-72f6-49b6-ba91-f21150946d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.094521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25649d-72f6-49b6-ba91-f21150946d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.095448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25649d-72f6-49b6-ba91-f21150946d83 admin admin] PATH_INFO: `/v3/projects/7379099e2373497885a354a670c5c3f7/users/0276fc4e0b394b4182f6f034ea0edd36/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.097519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd1721-954e-4867-a154-ffd37e59d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:30.098272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd1721-954e-4867-a154-ffd37e59d3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.098566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd1721-954e-4867-a154-ffd37e59d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.098699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25649d-72f6-49b6-ba91-f21150946d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7379099e2373497885a354a670c5c3f7, user_id=0276fc4e0b394b4182f6f034ea0edd36, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:30.098846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd1721-954e-4867-a154-ffd37e59d3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.099536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd1721-954e-4867-a154-ffd37e59d3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:30.101143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd1721-954e-4867-a154-ffd37e59d3b8 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:30.101959 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25649d-72f6-49b6-ba91-f21150946d83 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:30.114828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1122/2273] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:30.116094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df064b-09ee-46dd-9c27-1ad5fc2c2c7c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.116384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df064b-09ee-46dd-9c27-1ad5fc2c2c7c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.116664 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df064b-09ee-46dd-9c27-1ad5fc2c2c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.125904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1152/2274] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:30 2022] PUT /identity/v3/projects/7379099e2373497885a354a670c5c3f7/users/0276fc4e0b394b4182f6f034ea0edd36/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:30.127070 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25649d-72f6-49b6-ba91-f21150946d83 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.145366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-39df064b-09ee-46dd-9c27-1ad5fc2c2c7c None None] MFA Rules not processed for user `6c2704c142f54c9e8e1058ff8111bb83`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:30.147103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-39df064b-09ee-46dd-9c27-1ad5fc2c2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:30.214148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25649d-72f6-49b6-ba91-f21150946d83 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:30.219040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffeb06-2a18-43d8-b06c-772f49d10e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:30.219725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffeb06-2a18-43d8-b06c-772f49d10e17 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.220006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffeb06-2a18-43d8-b06c-772f49d10e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.220278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffeb06-2a18-43d8-b06c-772f49d10e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.220979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffeb06-2a18-43d8-b06c-772f49d10e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:30.222675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffeb06-2a18-43d8-b06c-772f49d10e17 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:30.230094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:30.230094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1123/2275] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:30.230094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebcfc2-194a-437a-94bb-983d8bbc0905 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.230538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebcfc2-194a-437a-94bb-983d8bbc0905 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.230677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebcfc2-194a-437a-94bb-983d8bbc0905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.238700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1153/2276] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:30.244298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffeb06-2a18-43d8-b06c-772f49d10e17 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.272533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffeb06-2a18-43d8-b06c-772f49d10e17 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:30.288402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-bdebcfc2-194a-437a-94bb-983d8bbc0905 None None] MFA Rules not processed for user `0276fc4e0b394b4182f6f034ea0edd36`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:30.292757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb589cb1-884d-47ca-a018-fedeadf2fde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:30.292923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bdebcfc2-194a-437a-94bb-983d8bbc0905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:30.293021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb589cb1-884d-47ca-a018-fedeadf2fde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.293021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb589cb1-884d-47ca-a018-fedeadf2fde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.293021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb589cb1-884d-47ca-a018-fedeadf2fde6 admin admin] PATH_INFO: `/v3/projects/ba391c4f7e154053a7447ae33b2bc8a5/users/90d6536e15f04ecca65568671f0a045a/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.326098 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb589cb1-884d-47ca-a018-fedeadf2fde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba391c4f7e154053a7447ae33b2bc8a5, user_id=90d6536e15f04ecca65568671f0a045a, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:30.342607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb589cb1-884d-47ca-a018-fedeadf2fde6 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:30.432915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1124/2277] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:30.458319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebcfc2-194a-437a-94bb-983d8bbc0905 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.458600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1154/2278] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:30 2022] PUT /identity/v3/projects/ba391c4f7e154053a7447ae33b2bc8a5/users/90d6536e15f04ecca65568671f0a045a/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:30.458725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bdebcfc2-194a-437a-94bb-983d8bbc0905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:30.468561 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1f62-9448-4674-b1e8-ed7e813c393a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.468867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1f62-9448-4674-b1e8-ed7e813c393a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.469154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1f62-9448-4674-b1e8-ed7e813c393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.536783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d68f1f62-9448-4674-b1e8-ed7e813c393a None None] MFA Rules not processed for user `90d6536e15f04ecca65568671f0a045a`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:30.543939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d68f1f62-9448-4674-b1e8-ed7e813c393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:30.568582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:30.611474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebcfc2-194a-437a-94bb-983d8bbc0905 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:30.691693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1155/2279] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:30.697659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f1f62-9448-4674-b1e8-ed7e813c393a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.715668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2b6ab-3337-44c3-a449-2bcb12e5b276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:30.715668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2b6ab-3337-44c3-a449-2bcb12e5b276 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.715668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2b6ab-3337-44c3-a449-2bcb12e5b276 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.715668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2b6ab-3337-44c3-a449-2bcb12e5b276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.790712 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f1f62-9448-4674-b1e8-ed7e813c393a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:30.796612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33d23e-a667-4a46-96ac-9a791c1641b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:30.797389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33d23e-a667-4a46-96ac-9a791c1641b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.797682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33d23e-a667-4a46-96ac-9a791c1641b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.797957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33d23e-a667-4a46-96ac-9a791c1641b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.798604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33d23e-a667-4a46-96ac-9a791c1641b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:30.800768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33d23e-a667-4a46-96ac-9a791c1641b3 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:30.807783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2b6ab-3337-44c3-a449-2bcb12e5b276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:30.809427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2b6ab-3337-44c3-a449-2bcb12e5b276 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:30.821146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1125/2280] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:56:30.927263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1156/2281] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:30 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:30.934227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2b6ab-3337-44c3-a449-2bcb12e5b276 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.945613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2b6ab-3337-44c3-a449-2bcb12e5b276 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:30.968859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33d23e-a667-4a46-96ac-9a791c1641b3 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.999731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:31.014241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd9930-ac72-4c3f-8d52-e60fd71a4939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:31.015427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd9930-ac72-4c3f-8d52-e60fd71a4939 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.015786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd9930-ac72-4c3f-8d52-e60fd71a4939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.019169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd9930-ac72-4c3f-8d52-e60fd71a4939 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.019169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd9930-ac72-4c3f-8d52-e60fd71a4939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:31.019883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd9930-ac72-4c3f-8d52-e60fd71a4939 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:31.037116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33d23e-a667-4a46-96ac-9a791c1641b3 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:31.041779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1fb8-bd4b-4766-b5bd-be958b7f80fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:31.043136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1fb8-bd4b-4766-b5bd-be958b7f80fc service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.043136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1fb8-bd4b-4766-b5bd-be958b7f80fc service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.043136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1fb8-bd4b-4766-b5bd-be958b7f80fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.103015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1fb8-bd4b-4766-b5bd-be958b7f80fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:31.104549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1fb8-bd4b-4766-b5bd-be958b7f80fc service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:31.114124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1157/2282] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:56:31.151183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1126/2283] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:30 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:31.154842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1fb8-bd4b-4766-b5bd-be958b7f80fc service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:31.166120 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1fb8-bd4b-4766-b5bd-be958b7f80fc service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:31.171252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5d33-65f3-42ec-ba9e-7f9c884a1e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:31.171885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5d33-65f3-42ec-ba9e-7f9c884a1e2a admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.172165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5d33-65f3-42ec-ba9e-7f9c884a1e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.178632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5d33-65f3-42ec-ba9e-7f9c884a1e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.178632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b5d33-65f3-42ec-ba9e-7f9c884a1e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:31.178632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b5d33-65f3-42ec-ba9e-7f9c884a1e2a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:31.186811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1158/2284] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:56:31.191971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd9930-ac72-4c3f-8d52-e60fd71a4939 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:31.203909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd9930-ac72-4c3f-8d52-e60fd71a4939 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:31.207964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1186-4347-498a-ab0c-25b7ee97ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:31.208635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1186-4347-498a-ab0c-25b7ee97ea56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.208905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1186-4347-498a-ab0c-25b7ee97ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.209176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b1186-4347-498a-ab0c-25b7ee97ea56 admin admin] PATH_INFO: `/v3/projects/46bab55df3514724924d18b95116db36/users/a79ad7725c7b4527882bd849da628076/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.224970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b1186-4347-498a-ab0c-25b7ee97ea56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bab55df3514724924d18b95116db36, user_id=a79ad7725c7b4527882bd849da628076, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:31.227738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b1186-4347-498a-ab0c-25b7ee97ea56 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:31.297742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1127/2285] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:31 2022] PUT /identity/v3/projects/46bab55df3514724924d18b95116db36/users/a79ad7725c7b4527882bd849da628076/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:31.301896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5d33-65f3-42ec-ba9e-7f9c884a1e2a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:31.312249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5d33-65f3-42ec-ba9e-7f9c884a1e2a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:31.413376 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baa138-af61-4b3f-b9bf-67fc316fe5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:31.414223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa138-af61-4b3f-b9bf-67fc316fe5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.414611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa138-af61-4b3f-b9bf-67fc316fe5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.415044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa138-af61-4b3f-b9bf-67fc316fe5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.416336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baa138-af61-4b3f-b9bf-67fc316fe5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:31.418886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baa138-af61-4b3f-b9bf-67fc316fe5e4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:31.439570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1159/2286] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:31.441942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1186-4347-498a-ab0c-25b7ee97ea56 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:31.452927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b1186-4347-498a-ab0c-25b7ee97ea56 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:31.459667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb47f38-9787-46e3-9ea8-d49885a01fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:31.460453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb47f38-9787-46e3-9ea8-d49885a01fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.460811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb47f38-9787-46e3-9ea8-d49885a01fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.461201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb47f38-9787-46e3-9ea8-d49885a01fbe admin admin] PATH_INFO: `/v3/projects/46bab55df3514724924d18b95116db36/users/a79ad7725c7b4527882bd849da628076/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.463331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb47f38-9787-46e3-9ea8-d49885a01fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bab55df3514724924d18b95116db36, user_id=a79ad7725c7b4527882bd849da628076, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:31.466371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb47f38-9787-46e3-9ea8-d49885a01fbe admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:31.495093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4b59b-66c0-4400-a668-1acc8036e6f7 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.495515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4b59b-66c0-4400-a668-1acc8036e6f7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.495866 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4b59b-66c0-4400-a668-1acc8036e6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.504174 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1128/2287] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:31 2022] PUT /identity/v3/projects/46bab55df3514724924d18b95116db36/users/a79ad7725c7b4527882bd849da628076/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:31.543759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2fd4b59b-66c0-4400-a668-1acc8036e6f7 None None] MFA Rules not processed for user `a79ad7725c7b4527882bd849da628076`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:31.545004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2fd4b59b-66c0-4400-a668-1acc8036e6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:31.650240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1160/2288] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:31.663212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb47f38-9787-46e3-9ea8-d49885a01fbe admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:31.665585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6bb47f38-9787-46e3-9ea8-d49885a01fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:31.761178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb47f38-9787-46e3-9ea8-d49885a01fbe admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:31.766659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8525622-8821-47f3-bbc0-266227f1b34c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:31.767564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8525622-8821-47f3-bbc0-266227f1b34c service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.768237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8525622-8821-47f3-bbc0-266227f1b34c service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.768644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8525622-8821-47f3-bbc0-266227f1b34c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.844040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8525622-8821-47f3-bbc0-266227f1b34c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:31.846762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8525622-8821-47f3-bbc0-266227f1b34c service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:31.871249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1129/2289] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:32.138627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:32.244019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:33.858089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:33.943731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:33.965678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4b59b-66c0-4400-a668-1acc8036e6f7 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:33.976936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4b59b-66c0-4400-a668-1acc8036e6f7 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:33.981671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b43106-f9c3-49e9-8698-cec10560ac02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:33.982479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b43106-f9c3-49e9-8698-cec10560ac02 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:33.983104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b43106-f9c3-49e9-8698-cec10560ac02 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:33.983574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b43106-f9c3-49e9-8698-cec10560ac02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:34.050056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b43106-f9c3-49e9-8698-cec10560ac02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:34.051623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b43106-f9c3-49e9-8698-cec10560ac02 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:34.061198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1161/2290] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:34.311761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8525622-8821-47f3-bbc0-266227f1b34c service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:34.379221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8525622-8821-47f3-bbc0-266227f1b34c service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:34.384127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:34.385108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:34.385244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:34.385514 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] PATH_INFO: `/v3/users/1ae7b4e8f73d400ca6464334889d0792` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:34.386950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae7b4e8f73d400ca6464334889d0792)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:34.388982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:34.463737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:34.589969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae7b4e8f73d400ca6464334889d0792'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:34.590780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae7b4e8f73d400ca6464334889d0792'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:34.591507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae7b4e8f73d400ca6464334889d0792'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:34.604754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae7b4e8f73d400ca6464334889d0792'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:34.697537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae7b4e8f73d400ca6464334889d0792'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:34.725240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1130/2291] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:34 2022] DELETE /identity/v3/users/1ae7b4e8f73d400ca6464334889d0792 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:34.729895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0ae0b-6945-4b8c-a960-1aceeb2cfaeb None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:34.730240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0ae0b-6945-4b8c-a960-1aceeb2cfaeb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:34.736503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0ae0b-6945-4b8c-a960-1aceeb2cfaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:34.749948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d7a0ae0b-6945-4b8c-a960-1aceeb2cfaeb None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:34.751028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d7a0ae0b-6945-4b8c-a960-1aceeb2cfaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:34.817402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1162/2292] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:34.827154 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:34.828625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:34.890749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea944e9-ce86-4e74-9c65-3ad8ca52d2fa admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:34.895446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede8729-dd41-47e8-ace8-c67b4f0f3096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:34.896062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede8729-dd41-47e8-ace8-c67b4f0f3096 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:34.896358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede8729-dd41-47e8-ace8-c67b4f0f3096 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:34.896668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede8729-dd41-47e8-ace8-c67b4f0f3096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:34.906024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede8729-dd41-47e8-ace8-c67b4f0f3096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:34.907564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede8729-dd41-47e8-ace8-c67b4f0f3096 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:34.917250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1131/2293] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:35.443515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0ae0b-6945-4b8c-a960-1aceeb2cfaeb None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:35.445107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d7a0ae0b-6945-4b8c-a960-1aceeb2cfaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:35.458253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:35.460380 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0ae0b-6945-4b8c-a960-1aceeb2cfaeb None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:35.468782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:35.469642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:35.469923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:35.470375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] PATH_INFO: `/v3/projects/ea0969492cf84bfba662def333bcea1e` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:35.471767 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0969492cf84bfba662def333bcea1e)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:35.473904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:35.617662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0969492cf84bfba662def333bcea1e', 'request_id': 'req-b9d635fe-9f70-4647-b859-8aaa773691c5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:35.624054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0969492cf84bfba662def333bcea1e', 'request_id': 'req-b9d635fe-9f70-4647-b859-8aaa773691c5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:35.646246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede8729-dd41-47e8-ace8-c67b4f0f3096 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:35.647694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4ede8729-dd41-47e8-ace8-c67b4f0f3096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:35.691138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0969492cf84bfba662def333bcea1e', 'request_id': 'req-b9d635fe-9f70-4647-b859-8aaa773691c5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:35.702149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] The token cache is being invalidate because project ea0969492cf84bfba662def333bcea1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:35.702444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:35.703083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:35.704609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1163/2294] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:35 2022] DELETE /identity/v3/projects/ea0969492cf84bfba662def333bcea1e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:35.705250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede8729-dd41-47e8-ace8-c67b4f0f3096 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:35.708588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:35.710095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:35.765742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec41ff-0a97-4fc2-b30c-658355eb5e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:35.766418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec41ff-0a97-4fc2-b30c-658355eb5e56 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:35.766682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec41ff-0a97-4fc2-b30c-658355eb5e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:35.766958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec41ff-0a97-4fc2-b30c-658355eb5e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:35.768996 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bbec41ff-0a97-4fc2-b30c-658355eb5e56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:35.790216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d635fe-9f70-4647-b859-8aaa773691c5 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:35.793704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:35.794377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:35.794657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:35.794928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] PATH_INFO: `/v3/users/0276fc4e0b394b4182f6f034ea0edd36` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:35.796261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0276fc4e0b394b4182f6f034ea0edd36)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:35.798228 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:35.848994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec41ff-0a97-4fc2-b30c-658355eb5e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:35.850376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec41ff-0a97-4fc2-b30c-658355eb5e56 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:35.863644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1132/2295] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:56:36.000893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0276fc4e0b394b4182f6f034ea0edd36'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.001685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0276fc4e0b394b4182f6f034ea0edd36'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.004310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0276fc4e0b394b4182f6f034ea0edd36'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.086715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0276fc4e0b394b4182f6f034ea0edd36'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.103338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fe363928-b888-4235-931d-410e02f86360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0276fc4e0b394b4182f6f034ea0edd36'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.129645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1164/2296] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:35 2022] DELETE /identity/v3/users/0276fc4e0b394b4182f6f034ea0edd36 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:36.162137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:36.229312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:36.671817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec41ff-0a97-4fc2-b30c-658355eb5e56 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:36.684333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec41ff-0a97-4fc2-b30c-658355eb5e56 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:36.752423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:36.753060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:36.753344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:36.754001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] PATH_INFO: `/v3/projects/7379099e2373497885a354a670c5c3f7` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:36.754819 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7379099e2373497885a354a670c5c3f7)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:36.756788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:36.881430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7379099e2373497885a354a670c5c3f7', 'request_id': 'req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.960373 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7379099e2373497885a354a670c5c3f7', 'request_id': 'req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.967660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7379099e2373497885a354a670c5c3f7', 'request_id': 'req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.978707 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] The token cache is being invalidate because project 7379099e2373497885a354a670c5c3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:36.978998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.979733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-3b51a03b-ce8e-4d1e-aadb-380caafb47c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:36.981210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1133/2297] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:36 2022] DELETE /identity/v3/projects/7379099e2373497885a354a670c5c3f7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:36.987571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325e336-b920-4c9d-8182-f2e9de6b453a None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:36.988190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325e336-b920-4c9d-8182-f2e9de6b453a None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:36.988681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325e336-b920-4c9d-8182-f2e9de6b453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.009255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3325e336-b920-4c9d-8182-f2e9de6b453a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:37.010514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3325e336-b920-4c9d-8182-f2e9de6b453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:37.085573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1165/2298] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:37.093626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920a352-ab01-43ee-a6b0-68fc9c6896af None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.093914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920a352-ab01-43ee-a6b0-68fc9c6896af None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.094196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920a352-ab01-43ee-a6b0-68fc9c6896af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.117258 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-b920a352-ab01-43ee-a6b0-68fc9c6896af None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:37.118485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b920a352-ab01-43ee-a6b0-68fc9c6896af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:37.126906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1134/2299] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:37.132276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325e336-b920-4c9d-8182-f2e9de6b453a None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:37.143281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325e336-b920-4c9d-8182-f2e9de6b453a None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:37.151049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d48a1b-58bb-45cf-a08d-df74920c868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:37.151049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d48a1b-58bb-45cf-a08d-df74920c868f admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.151049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d48a1b-58bb-45cf-a08d-df74920c868f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.151049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d48a1b-58bb-45cf-a08d-df74920c868f admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.151701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d48a1b-58bb-45cf-a08d-df74920c868f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:56:37.151701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d48a1b-58bb-45cf-a08d-df74920c868f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:37.151907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d48a1b-58bb-45cf-a08d-df74920c868f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:37.177535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1166/2300] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:56:37.179771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920a352-ab01-43ee-a6b0-68fc9c6896af None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:37.194074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920a352-ab01-43ee-a6b0-68fc9c6896af None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:37.210002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6d873-2f2b-4252-8ad6-d62bae34fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:37.210630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6d873-2f2b-4252-8ad6-d62bae34fa8f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.210911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6d873-2f2b-4252-8ad6-d62bae34fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.211187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6d873-2f2b-4252-8ad6-d62bae34fa8f admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.211847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6d873-2f2b-4252-8ad6-d62bae34fa8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:37.214408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6d873-2f2b-4252-8ad6-d62bae34fa8f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:37.354766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1135/2301] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:37 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:37.357571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d48a1b-58bb-45cf-a08d-df74920c868f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:37.369429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d48a1b-58bb-45cf-a08d-df74920c868f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:37.434549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8343-67d1-4e6e-b203-09dca338ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:37.435233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8343-67d1-4e6e-b203-09dca338ff48 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.435600 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8343-67d1-4e6e-b203-09dca338ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.436138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8343-67d1-4e6e-b203-09dca338ff48 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.436765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa8343-67d1-4e6e-b203-09dca338ff48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:37.438787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa8343-67d1-4e6e-b203-09dca338ff48 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:37.522324 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1167/2302] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:37 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:37.525146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6d873-2f2b-4252-8ad6-d62bae34fa8f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:37.535528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6d873-2f2b-4252-8ad6-d62bae34fa8f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:37.540422 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23aba0-5ae3-4295-b87d-0fc4cdd739eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:37.541034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23aba0-5ae3-4295-b87d-0fc4cdd739eb admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.541314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23aba0-5ae3-4295-b87d-0fc4cdd739eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.541604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23aba0-5ae3-4295-b87d-0fc4cdd739eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.542236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23aba0-5ae3-4295-b87d-0fc4cdd739eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:37.543877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23aba0-5ae3-4295-b87d-0fc4cdd739eb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:37.554436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1136/2303] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:37.558604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8343-67d1-4e6e-b203-09dca338ff48 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:37.570726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8343-67d1-4e6e-b203-09dca338ff48 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:37.575788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae3705-adbc-4d9d-ace4-ecb4e6c5eac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:37.576508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3705-adbc-4d9d-ace4-ecb4e6c5eac2 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.576833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3705-adbc-4d9d-ace4-ecb4e6c5eac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.577073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3705-adbc-4d9d-ace4-ecb4e6c5eac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.577779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3705-adbc-4d9d-ace4-ecb4e6c5eac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:37.579542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3705-adbc-4d9d-ace4-ecb4e6c5eac2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:37.597349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1168/2304] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:37.598579 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23aba0-5ae3-4295-b87d-0fc4cdd739eb admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:37.608531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23aba0-5ae3-4295-b87d-0fc4cdd739eb admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:37.614369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7d024-02a8-44d6-a41e-c2474b038998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:37.615029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7d024-02a8-44d6-a41e-c2474b038998 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.615326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7d024-02a8-44d6-a41e-c2474b038998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.615642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7d024-02a8-44d6-a41e-c2474b038998 admin admin] PATH_INFO: `/v3/projects/3008694e822a4edf8bbf3462e8dfc384/users/3191be7e7ccf4934b6861d15f92ccde1/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.633127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7d024-02a8-44d6-a41e-c2474b038998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3008694e822a4edf8bbf3462e8dfc384, user_id=3191be7e7ccf4934b6861d15f92ccde1, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:37.636103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7d024-02a8-44d6-a41e-c2474b038998 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:37.745379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1137/2305] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:37 2022] PUT /identity/v3/projects/3008694e822a4edf8bbf3462e8dfc384/users/3191be7e7ccf4934b6861d15f92ccde1/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:37.750689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9d7a6-48ed-4b90-82e2-811c3263629f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.750979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9d7a6-48ed-4b90-82e2-811c3263629f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.751254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9d7a6-48ed-4b90-82e2-811c3263629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.771059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-59b9d7a6-48ed-4b90-82e2-811c3263629f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:37.772308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-59b9d7a6-48ed-4b90-82e2-811c3263629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:37.855302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1169/2306] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:37.863151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7d024-02a8-44d6-a41e-c2474b038998 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:37.866612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a5f7d024-02a8-44d6-a41e-c2474b038998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:37.976693 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7d024-02a8-44d6-a41e-c2474b038998 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:37.981902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3e54d-1b7d-4c4f-ac4e-2f0109f744eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:37.982662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3e54d-1b7d-4c4f-ac4e-2f0109f744eb service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.983065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3e54d-1b7d-4c4f-ac4e-2f0109f744eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.983488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3e54d-1b7d-4c4f-ac4e-2f0109f744eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.994610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3e54d-1b7d-4c4f-ac4e-2f0109f744eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:37.996439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3e54d-1b7d-4c4f-ac4e-2f0109f744eb service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:38.008291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1138/2307] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:38.064057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:38.161045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:38.634894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:39.362762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df01d0-0d7e-44c7-b682-e1589deb0b67 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:39.366575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df01d0-0d7e-44c7-b682-e1589deb0b67 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:39.366575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df01d0-0d7e-44c7-b682-e1589deb0b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:39.408776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-36df01d0-0d7e-44c7-b682-e1589deb0b67 None None] MFA Rules not processed for user `3191be7e7ccf4934b6861d15f92ccde1`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:39.410222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-36df01d0-0d7e-44c7-b682-e1589deb0b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:39.495674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1170/2308] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:39.500498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3e54d-1b7d-4c4f-ac4e-2f0109f744eb service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:39.519506 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3e54d-1b7d-4c4f-ac4e-2f0109f744eb service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:39.524689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf605cc-de61-4db1-9ff3-3aed5859d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:39.525391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf605cc-de61-4db1-9ff3-3aed5859d0db admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:39.525753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf605cc-de61-4db1-9ff3-3aed5859d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:39.526106 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf605cc-de61-4db1-9ff3-3aed5859d0db admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:39.526825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf605cc-de61-4db1-9ff3-3aed5859d0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:39.528907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf605cc-de61-4db1-9ff3-3aed5859d0db admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:39.641472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1139/2309] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:39 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:39.646702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df01d0-0d7e-44c7-b682-e1589deb0b67 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:39.657579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df01d0-0d7e-44c7-b682-e1589deb0b67 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:39.718923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41265b1-472b-46c9-975d-78372e2e7887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:39.719646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41265b1-472b-46c9-975d-78372e2e7887 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:39.720001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41265b1-472b-46c9-975d-78372e2e7887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:39.720283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41265b1-472b-46c9-975d-78372e2e7887 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:39.720916 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41265b1-472b-46c9-975d-78372e2e7887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:39.723250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41265b1-472b-46c9-975d-78372e2e7887 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:39.818058 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:39.845849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1171/2310] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:39 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:39.847221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf605cc-de61-4db1-9ff3-3aed5859d0db admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:39.865186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf605cc-de61-4db1-9ff3-3aed5859d0db admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:39.873437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f420afe-fb08-4acc-bf7e-53be749e1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:39.874398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f420afe-fb08-4acc-bf7e-53be749e1b5b admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:39.874902 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f420afe-fb08-4acc-bf7e-53be749e1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:39.875425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f420afe-fb08-4acc-bf7e-53be749e1b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:39.876502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f420afe-fb08-4acc-bf7e-53be749e1b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:39.880104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f420afe-fb08-4acc-bf7e-53be749e1b5b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:39.899838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1140/2311] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:39.904239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41265b1-472b-46c9-975d-78372e2e7887 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:39.913326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41265b1-472b-46c9-975d-78372e2e7887 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:39.918151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b109e77-1314-4901-bde9-7e6df49f3dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:39.919019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b109e77-1314-4901-bde9-7e6df49f3dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:39.919337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b109e77-1314-4901-bde9-7e6df49f3dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:39.919628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b109e77-1314-4901-bde9-7e6df49f3dcf admin admin] PATH_INFO: `/v3/projects/1903cd3f5c2042869f39adc85ac1f9b8/users/f633188459bc423881bf26432d5a7963/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:39.938415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b109e77-1314-4901-bde9-7e6df49f3dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1903cd3f5c2042869f39adc85ac1f9b8, user_id=f633188459bc423881bf26432d5a7963, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:39.942804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b109e77-1314-4901-bde9-7e6df49f3dcf admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:40.035431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1172/2312] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:39 2022] PUT /identity/v3/projects/1903cd3f5c2042869f39adc85ac1f9b8/users/f633188459bc423881bf26432d5a7963/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:40.042849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f420afe-fb08-4acc-bf7e-53be749e1b5b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:40.057742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f420afe-fb08-4acc-bf7e-53be749e1b5b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:40.148516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747906b-3eec-49f0-9168-cd3beca46cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:40.149145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747906b-3eec-49f0-9168-cd3beca46cba admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:40.149424 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747906b-3eec-49f0-9168-cd3beca46cba admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:40.155376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747906b-3eec-49f0-9168-cd3beca46cba admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:40.155376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747906b-3eec-49f0-9168-cd3beca46cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:40.155376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747906b-3eec-49f0-9168-cd3beca46cba admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:40.167347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1141/2313] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:40.168598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b109e77-1314-4901-bde9-7e6df49f3dcf admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:40.184672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b109e77-1314-4901-bde9-7e6df49f3dcf admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:40.189719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860a163-3fa1-46e2-9c99-d10232595609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:40.190397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a163-3fa1-46e2-9c99-d10232595609 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:40.190711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a163-3fa1-46e2-9c99-d10232595609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:40.190957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a163-3fa1-46e2-9c99-d10232595609 admin admin] PATH_INFO: `/v3/projects/1903cd3f5c2042869f39adc85ac1f9b8/users/f633188459bc423881bf26432d5a7963/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:40.192914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a163-3fa1-46e2-9c99-d10232595609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1903cd3f5c2042869f39adc85ac1f9b8, user_id=f633188459bc423881bf26432d5a7963, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:40.195573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a163-3fa1-46e2-9c99-d10232595609 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:40.201054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:40.206373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1173/2314] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:40 2022] PUT /identity/v3/projects/1903cd3f5c2042869f39adc85ac1f9b8/users/f633188459bc423881bf26432d5a7963/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:40.772259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:41.212149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:41.315048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:41.719964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec04dc-2869-4ffa-9a09-270a813a5598 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:41.720301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec04dc-2869-4ffa-9a09-270a813a5598 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:41.720942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec04dc-2869-4ffa-9a09-270a813a5598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:41.758303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860a163-3fa1-46e2-9c99-d10232595609 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:41.760855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5860a163-3fa1-46e2-9c99-d10232595609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:41.774407 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8eec04dc-2869-4ffa-9a09-270a813a5598 None None] MFA Rules not processed for user `f633188459bc423881bf26432d5a7963`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:41.776493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8eec04dc-2869-4ffa-9a09-270a813a5598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:41.848189 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860a163-3fa1-46e2-9c99-d10232595609 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:41.853323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:41.853971 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:41.854305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:41.854590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] PATH_INFO: `/v3/users/1975c7ea12444fafada39fb5233e3982` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:41.855774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1975c7ea12444fafada39fb5233e3982)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:41.857964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:41.874399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1142/2315] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:41.889024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0838c9-fb6d-4f8f-823b-c41b3363aabd None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:41.889024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0838c9-fb6d-4f8f-823b-c41b3363aabd None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:41.889024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0838c9-fb6d-4f8f-823b-c41b3363aabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:41.908056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ef0838c9-fb6d-4f8f-823b-c41b3363aabd None None] MFA Rules not processed for user `3191be7e7ccf4934b6861d15f92ccde1`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:41.909959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ef0838c9-fb6d-4f8f-823b-c41b3363aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:41.986924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1143/2316] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:41.998031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0838c9-fb6d-4f8f-823b-c41b3363aabd None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:41.999518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ef0838c9-fb6d-4f8f-823b-c41b3363aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:42.078093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:42.092443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1975c7ea12444fafada39fb5233e3982'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:42.093368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1975c7ea12444fafada39fb5233e3982'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:42.094125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1975c7ea12444fafada39fb5233e3982'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:42.100050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0838c9-fb6d-4f8f-823b-c41b3363aabd None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:42.105752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a1bd5-1494-483d-acf7-5d450416144b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:42.106364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a1bd5-1494-483d-acf7-5d450416144b service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:42.106644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a1bd5-1494-483d-acf7-5d450416144b service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:42.106918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a1bd5-1494-483d-acf7-5d450416144b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:42.108722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-279a1bd5-1494-483d-acf7-5d450416144b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:42.123863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a1bd5-1494-483d-acf7-5d450416144b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:42.125527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a1bd5-1494-483d-acf7-5d450416144b service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:42.135633 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1144/2317] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:42.178390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1975c7ea12444fafada39fb5233e3982'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:42.195365 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:42.214560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1975c7ea12444fafada39fb5233e3982'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:42.240953 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1174/2318] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:41 2022] DELETE /identity/v3/users/1975c7ea12444fafada39fb5233e3982 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:42.248316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2ef9-0a32-4b1b-90bd-7ced021d8def None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:42.249030 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2ef9-0a32-4b1b-90bd-7ced021d8def None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:42.249030 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2ef9-0a32-4b1b-90bd-7ced021d8def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:42.272223 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-aa8c2ef9-0a32-4b1b-90bd-7ced021d8def None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:42.283450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-aa8c2ef9-0a32-4b1b-90bd-7ced021d8def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:42.388302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1145/2319] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:42.628365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:42.630334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:42.701801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce13a6-8c27-4a9c-8805-2d7846b1abdf admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:42.705501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb720ca-4d06-4043-bb3d-eaceb53e6e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:42.706136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb720ca-4d06-4043-bb3d-eaceb53e6e29 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:42.706412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb720ca-4d06-4043-bb3d-eaceb53e6e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:42.706680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb720ca-4d06-4043-bb3d-eaceb53e6e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:42.717353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb720ca-4d06-4043-bb3d-eaceb53e6e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:42.718790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb720ca-4d06-4043-bb3d-eaceb53e6e29 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:42.732340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1175/2320] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:56:42.744860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:42.835615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:42.902103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f2c61-54af-4871-994b-2a1ba02006ac None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:42.902734 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f2c61-54af-4871-994b-2a1ba02006ac None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:42.903386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f2c61-54af-4871-994b-2a1ba02006ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:42.943055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-341f2c61-54af-4871-994b-2a1ba02006ac None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:42.944374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-341f2c61-54af-4871-994b-2a1ba02006ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:42.955757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1146/2321] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:43.026222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb720ca-4d06-4043-bb3d-eaceb53e6e29 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:43.029196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ceb720ca-4d06-4043-bb3d-eaceb53e6e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:43.127944 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb720ca-4d06-4043-bb3d-eaceb53e6e29 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:43.134608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bd058-e495-4e96-9792-9394c89e9f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:43.135333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bd058-e495-4e96-9792-9394c89e9f56 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:43.135779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bd058-e495-4e96-9792-9394c89e9f56 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:43.136129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bd058-e495-4e96-9792-9394c89e9f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:43.146060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bd058-e495-4e96-9792-9394c89e9f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:43.148213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bd058-e495-4e96-9792-9394c89e9f56 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:43.159571 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1176/2322] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:43.309363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:43.337416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:43.492100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:43.500711 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f2c61-54af-4871-994b-2a1ba02006ac None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:43.502279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-341f2c61-54af-4871-994b-2a1ba02006ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:43.521847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f2c61-54af-4871-994b-2a1ba02006ac None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:43.532057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:43.534259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:43.534543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:43.534812 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] PATH_INFO: `/v3/projects/43e36db46bf24c6891e4e2a63b29a609` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:43.536029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e36db46bf24c6891e4e2a63b29a609)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:43.543845 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:43.577610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:43.661867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e36db46bf24c6891e4e2a63b29a609', 'request_id': 'req-1b285801-4893-4017-bf21-6567da1092ec'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:43.754146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e36db46bf24c6891e4e2a63b29a609', 'request_id': 'req-1b285801-4893-4017-bf21-6567da1092ec'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:43.761647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e36db46bf24c6891e4e2a63b29a609', 'request_id': 'req-1b285801-4893-4017-bf21-6567da1092ec'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:43.775277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] The token cache is being invalidate because project 43e36db46bf24c6891e4e2a63b29a609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:43.775881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:43.776960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:43.779104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1147/2323] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:43 2022] DELETE /identity/v3/projects/43e36db46bf24c6891e4e2a63b29a609 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:43.783913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bd058-e495-4e96-9792-9394c89e9f56 service nova] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:43.797481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bd058-e495-4e96-9792-9394c89e9f56 service nova] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:43.884430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:43.885537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:43.886030 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:43.886572 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] PATH_INFO: `/v3/users/90d6536e15f04ecca65568671f0a045a` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:43.888041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d6536e15f04ecca65568671f0a045a)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:43.890455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:44.182271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d6536e15f04ecca65568671f0a045a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:44.189940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d6536e15f04ecca65568671f0a045a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:44.189940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d6536e15f04ecca65568671f0a045a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:44.235239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d6536e15f04ecca65568671f0a045a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:44.252737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:44.253545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d6536e15f04ecca65568671f0a045a'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:44.270885 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1177/2324] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:43 2022] DELETE /identity/v3/users/90d6536e15f04ecca65568671f0a045a => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:44.532154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:44.829922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:44.832203 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:44.841667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:44.867831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285801-4893-4017-bf21-6567da1092ec admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:44.903064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:44.929222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:44.930009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:44.930187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:44.930775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] PATH_INFO: `/v3/projects/ba391c4f7e154053a7447ae33b2bc8a5` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:44.931721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba391c4f7e154053a7447ae33b2bc8a5)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:44.933638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:45.046409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:45.060153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba391c4f7e154053a7447ae33b2bc8a5', 'request_id': 'req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.114216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba391c4f7e154053a7447ae33b2bc8a5', 'request_id': 'req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.121076 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba391c4f7e154053a7447ae33b2bc8a5', 'request_id': 'req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.131786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] The token cache is being invalidate because project ba391c4f7e154053a7447ae33b2bc8a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:45.132074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.132711 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.134196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1148/2325] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:44 2022] DELETE /identity/v3/projects/ba391c4f7e154053a7447ae33b2bc8a5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:45.138255 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:45.139869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:45.153411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fc5b-93f4-44fc-9193-5341450ffbd2 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:45.171890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:45.211988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:45.212653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:45.212942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:45.213218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] PATH_INFO: `/v3/users/a79ad7725c7b4527882bd849da628076` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:45.214337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79ad7725c7b4527882bd849da628076)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:45.217160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:45.225388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:45.240403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:45.297605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:45.370793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79ad7725c7b4527882bd849da628076'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.371468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79ad7725c7b4527882bd849da628076'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.372062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79ad7725c7b4527882bd849da628076'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.422745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79ad7725c7b4527882bd849da628076'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.436375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2cd6f16c-38dd-44ff-8471-80df921fe11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79ad7725c7b4527882bd849da628076'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:45.450382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1178/2326] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:45 2022] DELETE /identity/v3/users/a79ad7725c7b4527882bd849da628076 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:46.000457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:46.003145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:46.019253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348de8e0-66d6-431f-a5ad-dc7ca39a1f63 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:46.091498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:46.092062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.092343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.092620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] PATH_INFO: `/v3/projects/46bab55df3514724924d18b95116db36` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.093807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bab55df3514724924d18b95116db36)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:46.095936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:46.209968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bab55df3514724924d18b95116db36', 'request_id': 'req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:46.291428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bab55df3514724924d18b95116db36', 'request_id': 'req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:46.298775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bab55df3514724924d18b95116db36', 'request_id': 'req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:46.309471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] The token cache is being invalidate because project 46bab55df3514724924d18b95116db36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:56:46.309753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:46.310388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a3e6c0ce-9d8d-4945-8c73-6f989eb7cc70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:56:46.312201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1149/2327] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:56:45 2022] DELETE /identity/v3/projects/46bab55df3514724924d18b95116db36 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:46.317679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7cda6-575b-4391-8673-11531f0e45dc None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.318159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7cda6-575b-4391-8673-11531f0e45dc None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.318251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7cda6-575b-4391-8673-11531f0e45dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.338038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c5a7cda6-575b-4391-8673-11531f0e45dc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:46.339259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c5a7cda6-575b-4391-8673-11531f0e45dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:46.400447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1179/2328] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:46.408597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670537cf-66a0-4c42-becf-600528a0d3f9 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.408953 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670537cf-66a0-4c42-becf-600528a0d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.409229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670537cf-66a0-4c42-becf-600528a0d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.428273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-670537cf-66a0-4c42-becf-600528a0d3f9 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:46.429441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-670537cf-66a0-4c42-becf-600528a0d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:46.437403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1150/2329] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:46.442093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7cda6-575b-4391-8673-11531f0e45dc None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:46.451669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7cda6-575b-4391-8673-11531f0e45dc None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:46.456947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a2dd5-4060-4e88-8a7c-c0ae534cae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:46.457543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a2dd5-4060-4e88-8a7c-c0ae534cae58 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.457825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a2dd5-4060-4e88-8a7c-c0ae534cae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.458101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a2dd5-4060-4e88-8a7c-c0ae534cae58 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.458745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a2dd5-4060-4e88-8a7c-c0ae534cae58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:56:46.459049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a2dd5-4060-4e88-8a7c-c0ae534cae58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:46.460717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a2dd5-4060-4e88-8a7c-c0ae534cae58 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:46.472738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1180/2330] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:56:46.476856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670537cf-66a0-4c42-becf-600528a0d3f9 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:46.487140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670537cf-66a0-4c42-becf-600528a0d3f9 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:46.491856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5935f-9a88-40ea-bd61-78099ccd83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:46.492582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5935f-9a88-40ea-bd61-78099ccd83b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.492717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5935f-9a88-40ea-bd61-78099ccd83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.492989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5935f-9a88-40ea-bd61-78099ccd83b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.493619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5935f-9a88-40ea-bd61-78099ccd83b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:46.495547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5935f-9a88-40ea-bd61-78099ccd83b1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:46.597061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1151/2331] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:46 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:46.601051 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a2dd5-4060-4e88-8a7c-c0ae534cae58 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:46.611645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a2dd5-4060-4e88-8a7c-c0ae534cae58 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:46.669514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37208710-9a79-431b-a3db-7838533f5c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:46.670238 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37208710-9a79-431b-a3db-7838533f5c29 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.670521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37208710-9a79-431b-a3db-7838533f5c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.670798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37208710-9a79-431b-a3db-7838533f5c29 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.671475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37208710-9a79-431b-a3db-7838533f5c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:46.673455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37208710-9a79-431b-a3db-7838533f5c29 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:46.795595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:46.801162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1181/2332] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:46 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:46.805266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5935f-9a88-40ea-bd61-78099ccd83b1 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:46.815801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5935f-9a88-40ea-bd61-78099ccd83b1 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:46.820184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bb352-1249-4775-b2b3-66494ae9fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:46.820770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bb352-1249-4775-b2b3-66494ae9fb4e admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.821046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bb352-1249-4775-b2b3-66494ae9fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.821315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bb352-1249-4775-b2b3-66494ae9fb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.821949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bb352-1249-4775-b2b3-66494ae9fb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:46.823579 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bb352-1249-4775-b2b3-66494ae9fb4e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:46.834809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1152/2333] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:56:46.838730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37208710-9a79-431b-a3db-7838533f5c29 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:46.850386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37208710-9a79-431b-a3db-7838533f5c29 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:46.855771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5f456-2fe0-4cca-a3b3-ad27048d8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:46.856518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5f456-2fe0-4cca-a3b3-ad27048d8efa admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.856812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5f456-2fe0-4cca-a3b3-ad27048d8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.857063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5f456-2fe0-4cca-a3b3-ad27048d8efa admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.857708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5f456-2fe0-4cca-a3b3-ad27048d8efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:46.859340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5f456-2fe0-4cca-a3b3-ad27048d8efa admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:46.870942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1182/2334] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:46.875239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bb352-1249-4775-b2b3-66494ae9fb4e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:46.886147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bb352-1249-4775-b2b3-66494ae9fb4e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:46.891138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd7d87-f6a6-4e58-95b3-8c1fccb20ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:46.891841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd7d87-f6a6-4e58-95b3-8c1fccb20ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.892736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd7d87-f6a6-4e58-95b3-8c1fccb20ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.893012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd7d87-f6a6-4e58-95b3-8c1fccb20ec6 admin admin] PATH_INFO: `/v3/projects/d4634703f6894da9b528f739c0a2e012/users/c2986de78a0740338c65ffe993965daf/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.909320 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd7d87-f6a6-4e58-95b3-8c1fccb20ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4634703f6894da9b528f739c0a2e012, user_id=c2986de78a0740338c65ffe993965daf, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:46.912132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd7d87-f6a6-4e58-95b3-8c1fccb20ec6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:47.007235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1153/2335] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:46 2022] PUT /identity/v3/projects/d4634703f6894da9b528f739c0a2e012/users/c2986de78a0740338c65ffe993965daf/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:56:47.018023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0e7f-542a-4fd6-9707-c514e7736e5e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:47.018321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0e7f-542a-4fd6-9707-c514e7736e5e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:47.018598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0e7f-542a-4fd6-9707-c514e7736e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:47.046369 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-4fdf0e7f-542a-4fd6-9707-c514e7736e5e None None] MFA Rules not processed for user `c2986de78a0740338c65ffe993965daf`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:47.047605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4fdf0e7f-542a-4fd6-9707-c514e7736e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:47.113560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1183/2336] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:47.118083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd7d87-f6a6-4e58-95b3-8c1fccb20ec6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:47.131584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:47.181497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd7d87-f6a6-4e58-95b3-8c1fccb20ec6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:47.188245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c6629-9740-42cb-b473-dbed5c4e2e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:47.189201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c6629-9740-42cb-b473-dbed5c4e2e11 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:47.189491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c6629-9740-42cb-b473-dbed5c4e2e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:47.189893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c6629-9740-42cb-b473-dbed5c4e2e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:47.190535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c6629-9740-42cb-b473-dbed5c4e2e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:47.192501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c6629-9740-42cb-b473-dbed5c4e2e11 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:47.316329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1154/2337] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:47 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:47.320304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf0e7f-542a-4fd6-9707-c514e7736e5e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:47.331812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf0e7f-542a-4fd6-9707-c514e7736e5e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:47.389051 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25675d-a0ef-42d7-93b8-09755454deed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:47.389584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25675d-a0ef-42d7-93b8-09755454deed admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:47.389862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25675d-a0ef-42d7-93b8-09755454deed admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:47.390133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25675d-a0ef-42d7-93b8-09755454deed admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:47.390799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25675d-a0ef-42d7-93b8-09755454deed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:47.393523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25675d-a0ef-42d7-93b8-09755454deed admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:47.450886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1184/2338] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:47 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:56:47.455307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c6629-9740-42cb-b473-dbed5c4e2e11 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:47.465803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c6629-9740-42cb-b473-dbed5c4e2e11 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:47.470940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721806a-fe50-418d-90cb-aaa430c88b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:47.471563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721806a-fe50-418d-90cb-aaa430c88b18 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:47.471860 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721806a-fe50-418d-90cb-aaa430c88b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:47.472139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721806a-fe50-418d-90cb-aaa430c88b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:47.472776 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721806a-fe50-418d-90cb-aaa430c88b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:47.474371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721806a-fe50-418d-90cb-aaa430c88b18 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:47.484874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1155/2339] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:47.489130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25675d-a0ef-42d7-93b8-09755454deed admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:47.499345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25675d-a0ef-42d7-93b8-09755454deed admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:47.504213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3330-ee7d-4d28-9f9e-aba85c2bdc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:47.504762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3330-ee7d-4d28-9f9e-aba85c2bdc7e admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:47.505043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3330-ee7d-4d28-9f9e-aba85c2bdc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:47.505318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3330-ee7d-4d28-9f9e-aba85c2bdc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:47.505951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e3330-ee7d-4d28-9f9e-aba85c2bdc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:47.507633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e3330-ee7d-4d28-9f9e-aba85c2bdc7e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:47.518159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1185/2340] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:56:47.522350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721806a-fe50-418d-90cb-aaa430c88b18 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:47.532337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721806a-fe50-418d-90cb-aaa430c88b18 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:47.539016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635b918-a246-48f6-bc6d-d7d5e799b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:47.539393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635b918-a246-48f6-bc6d-d7d5e799b8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:47.539615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635b918-a246-48f6-bc6d-d7d5e799b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:47.539891 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635b918-a246-48f6-bc6d-d7d5e799b8d9 admin admin] PATH_INFO: `/v3/projects/665ae3226c1e44a6afdfc5c7ae6f6e00/users/d8c0ec434fa54ecfbecf39d89e906537/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:47.556563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635b918-a246-48f6-bc6d-d7d5e799b8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665ae3226c1e44a6afdfc5c7ae6f6e00, user_id=d8c0ec434fa54ecfbecf39d89e906537, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:47.559687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635b918-a246-48f6-bc6d-d7d5e799b8d9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:47.686203 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1156/2341] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:47 2022] PUT /identity/v3/projects/665ae3226c1e44a6afdfc5c7ae6f6e00/users/d8c0ec434fa54ecfbecf39d89e906537/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:47.697750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7b76-b391-487a-9509-2526700e5bcb None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:47.698041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7b76-b391-487a-9509-2526700e5bcb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:47.698317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7b76-b391-487a-9509-2526700e5bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:47.728029 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-861e7b76-b391-487a-9509-2526700e5bcb None None] MFA Rules not processed for user `d8c0ec434fa54ecfbecf39d89e906537`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:47.729623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-861e7b76-b391-487a-9509-2526700e5bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:47.777738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:47.797841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1186/2342] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:47.802592 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635b918-a246-48f6-bc6d-d7d5e799b8d9 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:47.866869 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635b918-a246-48f6-bc6d-d7d5e799b8d9 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:47.871565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd830c37-45d3-423f-bcd3-2c19c7e90699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:47.872167 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830c37-45d3-423f-bcd3-2c19c7e90699 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:47.872447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830c37-45d3-423f-bcd3-2c19c7e90699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:47.872720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830c37-45d3-423f-bcd3-2c19c7e90699 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:47.873349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd830c37-45d3-423f-bcd3-2c19c7e90699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:47.875252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd830c37-45d3-423f-bcd3-2c19c7e90699 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:47.966586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1157/2343] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:56:47 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:47.970657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7b76-b391-487a-9509-2526700e5bcb None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:47.981353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7b76-b391-487a-9509-2526700e5bcb None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:48.041135 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c283a-4b47-4bc2-bd52-20cde5fef3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:48.041746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c283a-4b47-4bc2-bd52-20cde5fef3ca admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:48.042038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c283a-4b47-4bc2-bd52-20cde5fef3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:48.042312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c283a-4b47-4bc2-bd52-20cde5fef3ca admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:48.042932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c283a-4b47-4bc2-bd52-20cde5fef3ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:48.045088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c283a-4b47-4bc2-bd52-20cde5fef3ca admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:48.132815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1187/2344] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:56:47 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:56:48.136551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd830c37-45d3-423f-bcd3-2c19c7e90699 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:48.147131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd830c37-45d3-423f-bcd3-2c19c7e90699 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:48.152260 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64cb6-2c13-4b5b-a6dd-d7758ae29bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:48.152883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64cb6-2c13-4b5b-a6dd-d7758ae29bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:48.153197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64cb6-2c13-4b5b-a6dd-d7758ae29bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:48.153538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64cb6-2c13-4b5b-a6dd-d7758ae29bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:48.154486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64cb6-2c13-4b5b-a6dd-d7758ae29bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:48.156366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64cb6-2c13-4b5b-a6dd-d7758ae29bd6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:48.168134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1158/2345] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:48.172520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c283a-4b47-4bc2-bd52-20cde5fef3ca admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:48.184256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c283a-4b47-4bc2-bd52-20cde5fef3ca admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:48.191637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a6f0d-4bc4-4a5b-adb0-6b41a233b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:48.192213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a6f0d-4bc4-4a5b-adb0-6b41a233b505 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:48.192497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a6f0d-4bc4-4a5b-adb0-6b41a233b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:48.192811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a6f0d-4bc4-4a5b-adb0-6b41a233b505 admin admin] PATH_INFO: `/v3/projects/b0eedd84be544cac8213d55d3d8b5928/users/098c0a0feeef44f8a1c7baf2393a72b9/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:48.207811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a6f0d-4bc4-4a5b-adb0-6b41a233b505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0eedd84be544cac8213d55d3d8b5928, user_id=098c0a0feeef44f8a1c7baf2393a72b9, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:48.210534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a6f0d-4bc4-4a5b-adb0-6b41a233b505 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:48.262704 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1188/2346] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:48 2022] PUT /identity/v3/projects/b0eedd84be544cac8213d55d3d8b5928/users/098c0a0feeef44f8a1c7baf2393a72b9/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:48.266811 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64cb6-2c13-4b5b-a6dd-d7758ae29bd6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:48.281699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64cb6-2c13-4b5b-a6dd-d7758ae29bd6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:48.320488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:48.352958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61915c92-6803-46cd-a70d-718ef43d91fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:48.354027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61915c92-6803-46cd-a70d-718ef43d91fe admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:48.355719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61915c92-6803-46cd-a70d-718ef43d91fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:48.356295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61915c92-6803-46cd-a70d-718ef43d91fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:48.357192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61915c92-6803-46cd-a70d-718ef43d91fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:48.364085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61915c92-6803-46cd-a70d-718ef43d91fe admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:48.381772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1159/2347] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:56:48.388177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a6f0d-4bc4-4a5b-adb0-6b41a233b505 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:48.401635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a6f0d-4bc4-4a5b-adb0-6b41a233b505 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:48.406808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df43312-dd66-41c6-b65b-7f0d29529099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:48.408194 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43312-dd66-41c6-b65b-7f0d29529099 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:48.409161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43312-dd66-41c6-b65b-7f0d29529099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:48.409441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43312-dd66-41c6-b65b-7f0d29529099 admin admin] PATH_INFO: `/v3/projects/b0eedd84be544cac8213d55d3d8b5928/users/098c0a0feeef44f8a1c7baf2393a72b9/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:48.413895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df43312-dd66-41c6-b65b-7f0d29529099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0eedd84be544cac8213d55d3d8b5928, user_id=098c0a0feeef44f8a1c7baf2393a72b9, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:48.416197 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df43312-dd66-41c6-b65b-7f0d29529099 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:48.431356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1189/2348] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:56:48 2022] PUT /identity/v3/projects/b0eedd84be544cac8213d55d3d8b5928/users/098c0a0feeef44f8a1c7baf2393a72b9/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:56:48.440606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038dafa-5fc4-4294-a427-0ab301b7751b None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:48.440925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038dafa-5fc4-4294-a427-0ab301b7751b None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:48.441232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038dafa-5fc4-4294-a427-0ab301b7751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:48.471230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-7038dafa-5fc4-4294-a427-0ab301b7751b None None] MFA Rules not processed for user `098c0a0feeef44f8a1c7baf2393a72b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:48.472612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7038dafa-5fc4-4294-a427-0ab301b7751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:48.545333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1160/2349] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:48.557970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df43312-dd66-41c6-b65b-7f0d29529099 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:48.559858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5df43312-dd66-41c6-b65b-7f0d29529099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:48.621184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df43312-dd66-41c6-b65b-7f0d29529099 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:48.624794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f4ba-6c76-4ef3-b0db-c239174ad00f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:48.625429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f4ba-6c76-4ef3-b0db-c239174ad00f service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:48.625708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f4ba-6c76-4ef3-b0db-c239174ad00f service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:48.625982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f4ba-6c76-4ef3-b0db-c239174ad00f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:48.681548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:48.685065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127f4ba-6c76-4ef3-b0db-c239174ad00f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:48.686812 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127f4ba-6c76-4ef3-b0db-c239174ad00f service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:48.696919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1190/2350] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:51.449680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b23b93-3785-4912-9ac7-2002e91a634c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:51.450187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b23b93-3785-4912-9ac7-2002e91a634c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:51.450292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b23b93-3785-4912-9ac7-2002e91a634c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:51.473028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-07b23b93-3785-4912-9ac7-2002e91a634c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:51.474705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-07b23b93-3785-4912-9ac7-2002e91a634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:51.546718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1161/2351] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:51.561786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f4ba-6c76-4ef3-b0db-c239174ad00f service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:51.565279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b127f4ba-6c76-4ef3-b0db-c239174ad00f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:51.637271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f4ba-6c76-4ef3-b0db-c239174ad00f service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:51.642819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932429e-ea96-43cc-952d-02edc73eb508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:51.643451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932429e-ea96-43cc-952d-02edc73eb508 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:51.643735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932429e-ea96-43cc-952d-02edc73eb508 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:51.644008 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932429e-ea96-43cc-952d-02edc73eb508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:51.652133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932429e-ea96-43cc-952d-02edc73eb508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:51.653823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932429e-ea96-43cc-952d-02edc73eb508 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:51.664032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1191/2352] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:56:52.232102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b23b93-3785-4912-9ac7-2002e91a634c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:52.242472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b23b93-3785-4912-9ac7-2002e91a634c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:52.246023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa69715-81c1-4e51-bd47-6251fd9b8515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:52.246620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa69715-81c1-4e51-bd47-6251fd9b8515 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:52.246903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa69715-81c1-4e51-bd47-6251fd9b8515 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:52.247180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa69715-81c1-4e51-bd47-6251fd9b8515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:52.308855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa69715-81c1-4e51-bd47-6251fd9b8515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:52.310343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa69715-81c1-4e51-bd47-6251fd9b8515 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:52.314971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:52.321730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1162/2353] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:53.704338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932429e-ea96-43cc-952d-02edc73eb508 service nova] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:53.713674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932429e-ea96-43cc-952d-02edc73eb508 service nova] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:53.717625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d9881-8db8-4842-9525-61ad02cb8c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:53.718178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d9881-8db8-4842-9525-61ad02cb8c9e service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:53.718465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d9881-8db8-4842-9525-61ad02cb8c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:53.718735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d9881-8db8-4842-9525-61ad02cb8c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:53.728743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d9881-8db8-4842-9525-61ad02cb8c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:53.730251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d9881-8db8-4842-9525-61ad02cb8c9e service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:53.740251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1192/2354] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:58.384359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b024d5-6101-465c-aeab-221c6cd0db42 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:58.385225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b024d5-6101-465c-aeab-221c6cd0db42 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:58.385528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b024d5-6101-465c-aeab-221c6cd0db42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:58.408530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-91b024d5-6101-465c-aeab-221c6cd0db42 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:58.410478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-91b024d5-6101-465c-aeab-221c6cd0db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:58.418528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1163/2355] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:58.506020 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d9881-8db8-4842-9525-61ad02cb8c9e service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:58.519019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d9881-8db8-4842-9525-61ad02cb8c9e service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:58.524740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab5e59-0e16-4ba2-979c-ee89dc0bc177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:58.525348 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab5e59-0e16-4ba2-979c-ee89dc0bc177 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:58.525639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab5e59-0e16-4ba2-979c-ee89dc0bc177 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:58.525925 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab5e59-0e16-4ba2-979c-ee89dc0bc177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:58.535587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab5e59-0e16-4ba2-979c-ee89dc0bc177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:58.537166 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab5e59-0e16-4ba2-979c-ee89dc0bc177 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:58.547202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1193/2356] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:58.602337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed8081-f542-4b49-b62b-429c169a4bfb None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:58.602622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed8081-f542-4b49-b62b-429c169a4bfb None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:58.603044 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed8081-f542-4b49-b62b-429c169a4bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:58.621844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-1fed8081-f542-4b49-b62b-429c169a4bfb None None] MFA Rules not processed for user `440c70c023534045b2d6a095db05302d`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:58.623034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1fed8081-f542-4b49-b62b-429c169a4bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:58.690942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1164/2357] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:56:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:58.785345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbec29f-d9ca-41a6-90f5-9a8cdf9572ef None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:58.785657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbec29f-d9ca-41a6-90f5-9a8cdf9572ef None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:58.785931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbec29f-d9ca-41a6-90f5-9a8cdf9572ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:58.806556 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8bbec29f-d9ca-41a6-90f5-9a8cdf9572ef None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:58.807896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8bbec29f-d9ca-41a6-90f5-9a8cdf9572ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:58.883749 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1194/2358] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:56:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:58.932885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed8081-f542-4b49-b62b-429c169a4bfb None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:58.934463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1fed8081-f542-4b49-b62b-429c169a4bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:59.018212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed8081-f542-4b49-b62b-429c169a4bfb None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:59.023469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a82dd-f215-409a-a865-f7172c88dc45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:59.024108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a82dd-f215-409a-a865-f7172c88dc45 service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:59.024387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a82dd-f215-409a-a865-f7172c88dc45 service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:59.024855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a82dd-f215-409a-a865-f7172c88dc45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:59.033813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a82dd-f215-409a-a865-f7172c88dc45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:59.035535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a82dd-f215-409a-a865-f7172c88dc45 service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:59.044395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1165/2359] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 07:56:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:56:59.695133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbec29f-d9ca-41a6-90f5-9a8cdf9572ef None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:59.723123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbec29f-d9ca-41a6-90f5-9a8cdf9572ef None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:59.742062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:59.743510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:59.744025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:59.744516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] PATH_INFO: `/v3/users/c2986de78a0740338c65ffe993965daf` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:59.746311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2986de78a0740338c65ffe993965daf)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:59.748730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:00.003015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2986de78a0740338c65ffe993965daf'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:00.003989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2986de78a0740338c65ffe993965daf'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:00.006279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2986de78a0740338c65ffe993965daf'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:00.012643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:00.136680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2986de78a0740338c65ffe993965daf'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:00.155011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2986de78a0740338c65ffe993965daf'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:00.176378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1195/2360] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:56:59 2022] DELETE /identity/v3/users/c2986de78a0740338c65ffe993965daf => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:00.179190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9c537-8311-447a-a0f9-45846275da9d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:00.180859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9c537-8311-447a-a0f9-45846275da9d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:00.181355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9c537-8311-447a-a0f9-45846275da9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:00.207807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e5a9c537-8311-447a-a0f9-45846275da9d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:00.209531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e5a9c537-8311-447a-a0f9-45846275da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:00.281876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1166/2361] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:00.291982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:00.293620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:00.396845 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67adc39-c16d-46d0-9f94-9a3cbc83d564 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:00.401525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12957051-8000-4a55-a29c-66973c76bda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:00.402355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12957051-8000-4a55-a29c-66973c76bda4 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:00.402624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12957051-8000-4a55-a29c-66973c76bda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:00.403020 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12957051-8000-4a55-a29c-66973c76bda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:00.415416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12957051-8000-4a55-a29c-66973c76bda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:00.417012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12957051-8000-4a55-a29c-66973c76bda4 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:00.430384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1196/2362] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:57:00.968214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9c537-8311-447a-a0f9-45846275da9d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:00.969671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e5a9c537-8311-447a-a0f9-45846275da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:01.011247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9c537-8311-447a-a0f9-45846275da9d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:01.038451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:01.040163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:01.041294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:01.041683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] PATH_INFO: `/v3/projects/d4634703f6894da9b528f739c0a2e012` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:01.044286 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4634703f6894da9b528f739c0a2e012)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:01.047200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:01.082848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:01.204934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4634703f6894da9b528f739c0a2e012', 'request_id': 'req-be1f940a-fdc6-41b8-979c-eb7394c40550'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.296546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4634703f6894da9b528f739c0a2e012', 'request_id': 'req-be1f940a-fdc6-41b8-979c-eb7394c40550'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.307778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4634703f6894da9b528f739c0a2e012', 'request_id': 'req-be1f940a-fdc6-41b8-979c-eb7394c40550'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.324612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] The token cache is being invalidate because project d4634703f6894da9b528f739c0a2e012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:01.324968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.325656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.328927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1167/2363] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:00 2022] DELETE /identity/v3/projects/d4634703f6894da9b528f739c0a2e012 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:01.331650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12957051-8000-4a55-a29c-66973c76bda4 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:01.346664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12957051-8000-4a55-a29c-66973c76bda4 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:01.428474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:01.429323 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:01.429611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:01.429893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] PATH_INFO: `/v3/users/d8c0ec434fa54ecfbecf39d89e906537` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:01.431106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c0ec434fa54ecfbecf39d89e906537)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:01.433289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:01.616741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c0ec434fa54ecfbecf39d89e906537'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.617611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c0ec434fa54ecfbecf39d89e906537'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.618325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c0ec434fa54ecfbecf39d89e906537'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.738131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c0ec434fa54ecfbecf39d89e906537'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.764545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c0ec434fa54ecfbecf39d89e906537'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:01.769707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:01.798195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1197/2364] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:01 2022] DELETE /identity/v3/users/d8c0ec434fa54ecfbecf39d89e906537 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:02.553137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:02.554598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:02.570285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f940a-fdc6-41b8-979c-eb7394c40550 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:02.710367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:02.711223 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:02.712120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:02.712526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] PATH_INFO: `/v3/projects/665ae3226c1e44a6afdfc5c7ae6f6e00` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:02.713822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665ae3226c1e44a6afdfc5c7ae6f6e00)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:02.715958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:02.891434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665ae3226c1e44a6afdfc5c7ae6f6e00', 'request_id': 'req-1cbe426c-17e6-496d-b9a9-eb809569e989'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:02.975964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665ae3226c1e44a6afdfc5c7ae6f6e00', 'request_id': 'req-1cbe426c-17e6-496d-b9a9-eb809569e989'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:02.985442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665ae3226c1e44a6afdfc5c7ae6f6e00', 'request_id': 'req-1cbe426c-17e6-496d-b9a9-eb809569e989'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:03.002540 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] The token cache is being invalidate because project 665ae3226c1e44a6afdfc5c7ae6f6e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:03.008442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:03.009273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1cbe426c-17e6-496d-b9a9-eb809569e989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:03.011787 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1168/2365] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:02 2022] DELETE /identity/v3/projects/665ae3226c1e44a6afdfc5c7ae6f6e00 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:03.018018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:03.022013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:03.039159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e30dfa-6557-4ef5-ab0b-1ac1a20e8bf8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:03.119737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:03.120672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:03.121226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:03.121664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] PATH_INFO: `/v3/users/098c0a0feeef44f8a1c7baf2393a72b9` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:03.123601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098c0a0feeef44f8a1c7baf2393a72b9)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:03.126664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:03.413750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098c0a0feeef44f8a1c7baf2393a72b9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:03.415930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098c0a0feeef44f8a1c7baf2393a72b9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:03.419396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098c0a0feeef44f8a1c7baf2393a72b9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:03.431792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd64c2-1cbc-4310-a21c-1ead68a02e7a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:03.441404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd64c2-1cbc-4310-a21c-1ead68a02e7a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:03.441404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd64c2-1cbc-4310-a21c-1ead68a02e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:03.493055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-67dd64c2-1cbc-4310-a21c-1ead68a02e7a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:03.495753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-67dd64c2-1cbc-4310-a21c-1ead68a02e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:03.525588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098c0a0feeef44f8a1c7baf2393a72b9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:03.531371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1169/2366] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:03.554076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098c0a0feeef44f8a1c7baf2393a72b9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:03.605417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1198/2367] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:03 2022] DELETE /identity/v3/users/098c0a0feeef44f8a1c7baf2393a72b9 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:03.815780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd64c2-1cbc-4310-a21c-1ead68a02e7a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:03.818107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-67dd64c2-1cbc-4310-a21c-1ead68a02e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:03.872774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:03.960302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd64c2-1cbc-4310-a21c-1ead68a02e7a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:04.120102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04c72c-ae8d-4aa0-9d50-00ea7b5f5f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:04.121219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04c72c-ae8d-4aa0-9d50-00ea7b5f5f7b service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:04.121502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04c72c-ae8d-4aa0-9d50-00ea7b5f5f7b service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:04.121961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04c72c-ae8d-4aa0-9d50-00ea7b5f5f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:04.205667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04c72c-ae8d-4aa0-9d50-00ea7b5f5f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:04.207864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04c72c-ae8d-4aa0-9d50-00ea7b5f5f7b service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:04.238971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1170/2368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:04.672215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:04.674257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:04.697886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcbbeb-d3ab-4f88-8f75-d97cba9f3290 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:04.708775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:04.709464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:04.712214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:04.712214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] PATH_INFO: `/v3/projects/b0eedd84be544cac8213d55d3d8b5928` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:04.712214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0eedd84be544cac8213d55d3d8b5928)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:04.714055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:04.903143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0eedd84be544cac8213d55d3d8b5928', 'request_id': 'req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:04.917851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0eedd84be544cac8213d55d3d8b5928', 'request_id': 'req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:05.016867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0eedd84be544cac8213d55d3d8b5928', 'request_id': 'req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:05.024039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:05.041306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] The token cache is being invalidate because project b0eedd84be544cac8213d55d3d8b5928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:05.043714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:05.047701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d225fccb-ee4b-4e7a-b4b7-a277bfa8980b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:05.053317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1199/2369] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:04 2022] DELETE /identity/v3/projects/b0eedd84be544cac8213d55d3d8b5928 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:05.058676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd7243-80f6-4c71-bd6b-cde75aae44a3 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.059450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd7243-80f6-4c71-bd6b-cde75aae44a3 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.059736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd7243-80f6-4c71-bd6b-cde75aae44a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.096018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a8bd7243-80f6-4c71-bd6b-cde75aae44a3 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:05.097911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a8bd7243-80f6-4c71-bd6b-cde75aae44a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:05.221995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1171/2370] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:05.233009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee01948-08fd-4799-b344-ef41ba151351 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.233305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee01948-08fd-4799-b344-ef41ba151351 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.233593 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee01948-08fd-4799-b344-ef41ba151351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.262867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-cee01948-08fd-4799-b344-ef41ba151351 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:05.263510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cee01948-08fd-4799-b344-ef41ba151351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:05.279079 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1200/2371] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:05.283448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd7243-80f6-4c71-bd6b-cde75aae44a3 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:05.293239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:05.300698 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd7243-80f6-4c71-bd6b-cde75aae44a3 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:05.307872 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763d66f-8cab-452d-945a-3f00b00c8f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:05.308766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763d66f-8cab-452d-945a-3f00b00c8f94 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.309913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763d66f-8cab-452d-945a-3f00b00c8f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.310713 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763d66f-8cab-452d-945a-3f00b00c8f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.311651 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763d66f-8cab-452d-945a-3f00b00c8f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:05.312314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763d66f-8cab-452d-945a-3f00b00c8f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:05.315957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763d66f-8cab-452d-945a-3f00b00c8f94 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:05.336027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1172/2372] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:05.340245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee01948-08fd-4799-b344-ef41ba151351 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:05.350439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee01948-08fd-4799-b344-ef41ba151351 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:05.356010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dc124-d1be-4aae-9bd6-c00747e1c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:05.357108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dc124-d1be-4aae-9bd6-c00747e1c7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.357648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dc124-d1be-4aae-9bd6-c00747e1c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.358129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dc124-d1be-4aae-9bd6-c00747e1c7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.358976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dc124-d1be-4aae-9bd6-c00747e1c7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:05.361652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dc124-d1be-4aae-9bd6-c00747e1c7d3 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:05.480475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1201/2373] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:05 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:05.484886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763d66f-8cab-452d-945a-3f00b00c8f94 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:05.498250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763d66f-8cab-452d-945a-3f00b00c8f94 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:05.596341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5f4d1-34cf-4052-b6ed-19e85f8933f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:05.597324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f4d1-34cf-4052-b6ed-19e85f8933f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.597769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f4d1-34cf-4052-b6ed-19e85f8933f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.598192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5f4d1-34cf-4052-b6ed-19e85f8933f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.599002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5f4d1-34cf-4052-b6ed-19e85f8933f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:05.601119 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5f4d1-34cf-4052-b6ed-19e85f8933f7 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:05.687162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1173/2374] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:05 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:05.692314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dc124-d1be-4aae-9bd6-c00747e1c7d3 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:05.709562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dc124-d1be-4aae-9bd6-c00747e1c7d3 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:05.714863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8440-aab3-4c45-92a5-01e5bea8c3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:05.715814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8440-aab3-4c45-92a5-01e5bea8c3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.716346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8440-aab3-4c45-92a5-01e5bea8c3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.716836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8440-aab3-4c45-92a5-01e5bea8c3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.717914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c8440-aab3-4c45-92a5-01e5bea8c3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:05.719778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c8440-aab3-4c45-92a5-01e5bea8c3f9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:05.732305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1202/2375] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:05.736533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5f4d1-34cf-4052-b6ed-19e85f8933f7 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:05.749483 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5f4d1-34cf-4052-b6ed-19e85f8933f7 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:05.764890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53e1e-27e3-4fa8-95d9-0d914365e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:05.764890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53e1e-27e3-4fa8-95d9-0d914365e78c admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.764890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53e1e-27e3-4fa8-95d9-0d914365e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.764890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53e1e-27e3-4fa8-95d9-0d914365e78c admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.765199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53e1e-27e3-4fa8-95d9-0d914365e78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:05.766352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53e1e-27e3-4fa8-95d9-0d914365e78c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:05.783135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1174/2376] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:57:05.787656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8440-aab3-4c45-92a5-01e5bea8c3f9 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:05.801346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8440-aab3-4c45-92a5-01e5bea8c3f9 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:05.811006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf971a49-03ad-40d9-9dff-c70590aa6cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:05.811810 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf971a49-03ad-40d9-9dff-c70590aa6cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.812159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf971a49-03ad-40d9-9dff-c70590aa6cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.812500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf971a49-03ad-40d9-9dff-c70590aa6cf1 admin admin] PATH_INFO: `/v3/projects/54059dd6af9d495192da6cb9822cf91c/users/6b5be3881b204313865f939cacadd514/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.831245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf971a49-03ad-40d9-9dff-c70590aa6cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54059dd6af9d495192da6cb9822cf91c, user_id=6b5be3881b204313865f939cacadd514, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:05.834664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf971a49-03ad-40d9-9dff-c70590aa6cf1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:05.899350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1203/2377] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:05 2022] PUT /identity/v3/projects/54059dd6af9d495192da6cb9822cf91c/users/6b5be3881b204313865f939cacadd514/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:05.910982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f6544-808d-4c69-b53f-c87987fd6cb1 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.910982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f6544-808d-4c69-b53f-c87987fd6cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.910982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f6544-808d-4c69-b53f-c87987fd6cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.948034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-bf4f6544-808d-4c69-b53f-c87987fd6cb1 None None] MFA Rules not processed for user `6b5be3881b204313865f939cacadd514`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:05.949818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bf4f6544-808d-4c69-b53f-c87987fd6cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:06.075327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1175/2378] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:06.089295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf971a49-03ad-40d9-9dff-c70590aa6cf1 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:06.091020 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cf971a49-03ad-40d9-9dff-c70590aa6cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:06.168943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf971a49-03ad-40d9-9dff-c70590aa6cf1 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:06.176049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f6d2a-d2cd-499f-a304-ede3f2814e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:06.176677 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f6d2a-d2cd-499f-a304-ede3f2814e3e service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:06.176959 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f6d2a-d2cd-499f-a304-ede3f2814e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:06.177234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f6d2a-d2cd-499f-a304-ede3f2814e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:06.188183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f6d2a-d2cd-499f-a304-ede3f2814e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:06.190623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f6d2a-d2cd-499f-a304-ede3f2814e3e service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:06.204176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1204/2379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:10.264254 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f6544-808d-4c69-b53f-c87987fd6cb1 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:10.281613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f6544-808d-4c69-b53f-c87987fd6cb1 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:10.290344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:10.291160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:10.291751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:10.292218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:10.296908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:10.433081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:10.440887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:10.442586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:10.467507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1176/2380] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:11.094169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593f070-5199-4835-af9e-074b1895cb34 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:11.094765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593f070-5199-4835-af9e-074b1895cb34 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:11.094930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593f070-5199-4835-af9e-074b1895cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:11.138213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d593f070-5199-4835-af9e-074b1895cb34 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:11.139692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d593f070-5199-4835-af9e-074b1895cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:11.265703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1205/2381] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:11.283152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:11.284946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:11.437004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2aa4-5029-4dd2-b225-3a4d4f48e7ab service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:11.461144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bdfe3-8fde-492d-a5a4-fa7db0691a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:11.461144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bdfe3-8fde-492d-a5a4-fa7db0691a75 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:11.461144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bdfe3-8fde-492d-a5a4-fa7db0691a75 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:11.461144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bdfe3-8fde-492d-a5a4-fa7db0691a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:11.472836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bdfe3-8fde-492d-a5a4-fa7db0691a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:11.474813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bdfe3-8fde-492d-a5a4-fa7db0691a75 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:11.489528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1177/2382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:20.567131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304f88a-1730-4449-b1e3-d737924aceef None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:20.567890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304f88a-1730-4449-b1e3-d737924aceef None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:20.568242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304f88a-1730-4449-b1e3-d737924aceef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:20.599279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-a304f88a-1730-4449-b1e3-d737924aceef None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:20.600559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a304f88a-1730-4449-b1e3-d737924aceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:20.608607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1206/2383] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:20.624515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bdfe3-8fde-492d-a5a4-fa7db0691a75 service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:20.636757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bdfe3-8fde-492d-a5a4-fa7db0691a75 service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:20.642847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fdc00-360e-4325-8f69-86925f022985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:20.643482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fdc00-360e-4325-8f69-86925f022985 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:20.643761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fdc00-360e-4325-8f69-86925f022985 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:20.644027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fdc00-360e-4325-8f69-86925f022985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:20.654617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fdc00-360e-4325-8f69-86925f022985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:20.656280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fdc00-360e-4325-8f69-86925f022985 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:20.666636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1178/2384] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:57:20.877156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c5e3-3786-41c0-9d7f-ef4d93bf56c5 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:20.877445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c5e3-3786-41c0-9d7f-ef4d93bf56c5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:20.877884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c5e3-3786-41c0-9d7f-ef4d93bf56c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:20.898099 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-09f2c5e3-3786-41c0-9d7f-ef4d93bf56c5 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:20.899615 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-09f2c5e3-3786-41c0-9d7f-ef4d93bf56c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:20.921390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:20.958699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1207/2385] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 07:57:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:20.971793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fdc00-360e-4325-8f69-86925f022985 service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:20.973227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3c7fdc00-360e-4325-8f69-86925f022985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:21.043646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fdc00-360e-4325-8f69-86925f022985 service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:21.049484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775299dd-3c62-44b8-be89-cc6b813046e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:21.050097 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775299dd-3c62-44b8-be89-cc6b813046e7 service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:21.050377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775299dd-3c62-44b8-be89-cc6b813046e7 service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:21.050650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775299dd-3c62-44b8-be89-cc6b813046e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:21.058994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775299dd-3c62-44b8-be89-cc6b813046e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:21.060907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775299dd-3c62-44b8-be89-cc6b813046e7 service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:21.069772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1179/2386] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 07:57:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:57:22.923762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2c5e3-3786-41c0-9d7f-ef4d93bf56c5 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:22.925315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-09f2c5e3-3786-41c0-9d7f-ef4d93bf56c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:22.984992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2c5e3-3786-41c0-9d7f-ef4d93bf56c5 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:22.989204 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2daa2-33ae-4ca0-8c60-dfc768a37c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:22.989853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2daa2-33ae-4ca0-8c60-dfc768a37c9f service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:22.994260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2daa2-33ae-4ca0-8c60-dfc768a37c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:22.994260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2daa2-33ae-4ca0-8c60-dfc768a37c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:22.994260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4ee2daa2-33ae-4ca0-8c60-dfc768a37c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:23.089687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2daa2-33ae-4ca0-8c60-dfc768a37c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:23.089687 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2daa2-33ae-4ca0-8c60-dfc768a37c9f service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:23.097034 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1208/2387] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:24.027861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68142d-d449-49a7-9bf4-84e82668c012 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:24.029039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68142d-d449-49a7-9bf4-84e82668c012 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:24.029583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68142d-d449-49a7-9bf4-84e82668c012 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:24.031529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1180/2388] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:57:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:24.040161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654decd3-8431-47b0-9d32-55983dbb26ee None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:24.041179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654decd3-8431-47b0-9d32-55983dbb26ee None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:24.041562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654decd3-8431-47b0-9d32-55983dbb26ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:24.068746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-654decd3-8431-47b0-9d32-55983dbb26ee None None] MFA Rules not processed for user `36bd5aef3c034c41be036c4cc9eed376`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:24.070210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-654decd3-8431-47b0-9d32-55983dbb26ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:24.138651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1209/2389] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:57:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:24.150163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68142d-d449-49a7-9bf4-84e82668c012 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:24.152000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-df68142d-d449-49a7-9bf4-84e82668c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:24.174972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68142d-d449-49a7-9bf4-84e82668c012 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:24.181301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a92f4-4d25-4730-853f-cd4a2485d106 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:24.187636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a92f4-4d25-4730-853f-cd4a2485d106 service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:24.187636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a92f4-4d25-4730-853f-cd4a2485d106 service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:24.187636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a92f4-4d25-4730-853f-cd4a2485d106 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:24.196080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654decd3-8431-47b0-9d32-55983dbb26ee None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:24.197300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a92f4-4d25-4730-853f-cd4a2485d106 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:24.197773 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-654decd3-8431-47b0-9d32-55983dbb26ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:24.202709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a92f4-4d25-4730-853f-cd4a2485d106 service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:24.213793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654decd3-8431-47b0-9d32-55983dbb26ee None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:24.215796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1181/2390] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:24.222356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:24.223007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:24.223307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:24.223596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] PATH_INFO: `/v3/users/9d544d38a5664f68bff83e6c9798ffd9` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:24.224756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d544d38a5664f68bff83e6c9798ffd9)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:24.226906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:24.246579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:24.384379 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d544d38a5664f68bff83e6c9798ffd9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:24.385424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d544d38a5664f68bff83e6c9798ffd9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:24.386044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d544d38a5664f68bff83e6c9798ffd9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:24.449162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d544d38a5664f68bff83e6c9798ffd9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:24.478983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91dabfc9-cec2-403d-90c5-706626ff0512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d544d38a5664f68bff83e6c9798ffd9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:24.503435 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1210/2391] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:24 2022] DELETE /identity/v3/users/9d544d38a5664f68bff83e6c9798ffd9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:24.778220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a92f4-4d25-4730-853f-cd4a2485d106 service placement] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:24.796725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a92f4-4d25-4730-853f-cd4a2485d106 service placement] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:24.844884 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:24.869227 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:24.869876 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:24.870161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:24.870441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] PATH_INFO: `/v3/projects/1eb1b0c1ea564a5c9ea4398c523f016e` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:24.871748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb1b0c1ea564a5c9ea4398c523f016e)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:24.873883 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:25.050093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb1b0c1ea564a5c9ea4398c523f016e', 'request_id': 'req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:25.118547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb1b0c1ea564a5c9ea4398c523f016e', 'request_id': 'req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:25.130504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb1b0c1ea564a5c9ea4398c523f016e', 'request_id': 'req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:25.146326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] The token cache is being invalidate because project 1eb1b0c1ea564a5c9ea4398c523f016e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:25.150725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:25.152081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-9e4e5a8c-0736-4fbd-98f9-c007153c8d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:25.154849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1182/2392] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:24 2022] DELETE /identity/v3/projects/1eb1b0c1ea564a5c9ea4398c523f016e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:25.160703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443513de-aaf5-4cf2-b533-e59a4e411b9e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:25.161759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443513de-aaf5-4cf2-b533-e59a4e411b9e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:25.162333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443513de-aaf5-4cf2-b533-e59a4e411b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:25.190436 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-443513de-aaf5-4cf2-b533-e59a4e411b9e None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:25.191732 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-443513de-aaf5-4cf2-b533-e59a4e411b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:25.269910 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1211/2393] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:25.278464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3299d-6e99-4dfc-8c9a-2a6f93f40271 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:25.278751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3299d-6e99-4dfc-8c9a-2a6f93f40271 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:25.279127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3299d-6e99-4dfc-8c9a-2a6f93f40271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:25.316749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-48d3299d-6e99-4dfc-8c9a-2a6f93f40271 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:25.318431 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-48d3299d-6e99-4dfc-8c9a-2a6f93f40271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:25.334593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1183/2394] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:25.338057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443513de-aaf5-4cf2-b533-e59a4e411b9e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:25.349258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443513de-aaf5-4cf2-b533-e59a4e411b9e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:25.358567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760838b-7d4a-423b-b249-61cf20ac1e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:25.359621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760838b-7d4a-423b-b249-61cf20ac1e65 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:25.360607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760838b-7d4a-423b-b249-61cf20ac1e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:25.361112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760838b-7d4a-423b-b249-61cf20ac1e65 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:25.361958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760838b-7d4a-423b-b249-61cf20ac1e65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:25.362425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760838b-7d4a-423b-b249-61cf20ac1e65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:25.364982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760838b-7d4a-423b-b249-61cf20ac1e65 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:25.379720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1212/2395] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:57:25.384256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3299d-6e99-4dfc-8c9a-2a6f93f40271 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:25.396213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3299d-6e99-4dfc-8c9a-2a6f93f40271 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:25.405719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2818f6-f37d-4241-9a5f-e0b081426c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:25.407054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2818f6-f37d-4241-9a5f-e0b081426c1f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:25.407906 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2818f6-f37d-4241-9a5f-e0b081426c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:25.408425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2818f6-f37d-4241-9a5f-e0b081426c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:25.409886 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2818f6-f37d-4241-9a5f-e0b081426c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:25.413407 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2818f6-f37d-4241-9a5f-e0b081426c1f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:25.526711 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1184/2396] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:25 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:57:25.534797 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760838b-7d4a-423b-b249-61cf20ac1e65 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:25.545838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760838b-7d4a-423b-b249-61cf20ac1e65 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:25.624226 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192aacd-5aab-4baf-842d-c0fbcad49487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:25.624940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192aacd-5aab-4baf-842d-c0fbcad49487 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:25.625400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192aacd-5aab-4baf-842d-c0fbcad49487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:25.634015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192aacd-5aab-4baf-842d-c0fbcad49487 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:25.634782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192aacd-5aab-4baf-842d-c0fbcad49487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:25.639026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192aacd-5aab-4baf-842d-c0fbcad49487 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:25.745937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1213/2397] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:25 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:57:25.750780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2818f6-f37d-4241-9a5f-e0b081426c1f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:25.762945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2818f6-f37d-4241-9a5f-e0b081426c1f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:25.769451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec923e0-152b-4b82-b4af-4b63caba9f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:25.770089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec923e0-152b-4b82-b4af-4b63caba9f8a admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:25.770376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec923e0-152b-4b82-b4af-4b63caba9f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:25.770651 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec923e0-152b-4b82-b4af-4b63caba9f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:25.771435 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec923e0-152b-4b82-b4af-4b63caba9f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:25.773764 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec923e0-152b-4b82-b4af-4b63caba9f8a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:25.789670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1185/2398] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:25.790858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192aacd-5aab-4baf-842d-c0fbcad49487 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:25.816384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192aacd-5aab-4baf-842d-c0fbcad49487 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:25.824535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f01aa9-23a4-4244-afe6-cebd06a0c54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:25.826192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01aa9-23a4-4244-afe6-cebd06a0c54b admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:25.826639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01aa9-23a4-4244-afe6-cebd06a0c54b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:25.826925 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01aa9-23a4-4244-afe6-cebd06a0c54b admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:25.828339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f01aa9-23a4-4244-afe6-cebd06a0c54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:25.830285 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f01aa9-23a4-4244-afe6-cebd06a0c54b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:25.832362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:25.843397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1214/2399] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:57:25.848204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec923e0-152b-4b82-b4af-4b63caba9f8a admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:25.862117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec923e0-152b-4b82-b4af-4b63caba9f8a admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:25.870060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3ab81-2e9a-4986-9bb8-6df045b96f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:25.871380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3ab81-2e9a-4986-9bb8-6df045b96f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:25.871572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3ab81-2e9a-4986-9bb8-6df045b96f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:25.871970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3ab81-2e9a-4986-9bb8-6df045b96f4e admin admin] PATH_INFO: `/v3/projects/0f77a272d73f42e18af0e9eb060eb449/users/d845ed93cccb45038088a0f32f7aec34/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:25.891837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3ab81-2e9a-4986-9bb8-6df045b96f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f77a272d73f42e18af0e9eb060eb449, user_id=d845ed93cccb45038088a0f32f7aec34, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:25.894767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3ab81-2e9a-4986-9bb8-6df045b96f4e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:26.016536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1186/2400] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:25 2022] PUT /identity/v3/projects/0f77a272d73f42e18af0e9eb060eb449/users/d845ed93cccb45038088a0f32f7aec34/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:26.027545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7601b9-6838-425d-a450-4cb037f642e8 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:26.027826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7601b9-6838-425d-a450-4cb037f642e8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:26.028113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7601b9-6838-425d-a450-4cb037f642e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:26.061874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ac7601b9-6838-425d-a450-4cb037f642e8 None None] MFA Rules not processed for user `d845ed93cccb45038088a0f32f7aec34`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:26.064010 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ac7601b9-6838-425d-a450-4cb037f642e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:26.144951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1215/2401] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:26.157873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3ab81-2e9a-4986-9bb8-6df045b96f4e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:26.159594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-29f3ab81-2e9a-4986-9bb8-6df045b96f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:26.254243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:26.258351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3ab81-2e9a-4986-9bb8-6df045b96f4e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:26.275656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd033ca-e691-4c4a-b967-df75426a16f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f436ac7cc2f04919bb0ec1ad9fca5622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:26.275656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd033ca-e691-4c4a-b967-df75426a16f8 service glance] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:26.275656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd033ca-e691-4c4a-b967-df75426a16f8 service glance] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:26.275656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd033ca-e691-4c4a-b967-df75426a16f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:26.277738 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd033ca-e691-4c4a-b967-df75426a16f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:26.279169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd033ca-e691-4c4a-b967-df75426a16f8 service glance] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:26.296817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1187/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:36.683954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=34 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:37.009175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:41.627036 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7601b9-6838-425d-a450-4cb037f642e8 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:41.628578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ac7601b9-6838-425d-a450-4cb037f642e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:41.698115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7601b9-6838-425d-a450-4cb037f642e8 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:41.702628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:41.703251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:41.703563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:41.703834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] PATH_INFO: `/v3/users/3191be7e7ccf4934b6861d15f92ccde1` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:41.704980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3191be7e7ccf4934b6861d15f92ccde1)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:41.706911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:41.902781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3191be7e7ccf4934b6861d15f92ccde1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.903474 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3191be7e7ccf4934b6861d15f92ccde1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.904085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3191be7e7ccf4934b6861d15f92ccde1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.963186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3191be7e7ccf4934b6861d15f92ccde1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.976740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3191be7e7ccf4934b6861d15f92ccde1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:41.988897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1216/2403] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:41 2022] DELETE /identity/v3/users/3191be7e7ccf4934b6861d15f92ccde1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:42.256012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd033ca-e691-4c4a-b967-df75426a16f8 service glance] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:42.267893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd033ca-e691-4c4a-b967-df75426a16f8 service glance] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:42.338823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:42.339855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:42.340248 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:42.340671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] PATH_INFO: `/v3/projects/3008694e822a4edf8bbf3462e8dfc384` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:42.342516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3008694e822a4edf8bbf3462e8dfc384)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:42.345967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:42.466362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3008694e822a4edf8bbf3462e8dfc384', 'request_id': 'req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.517452 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3008694e822a4edf8bbf3462e8dfc384', 'request_id': 'req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.524213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3008694e822a4edf8bbf3462e8dfc384', 'request_id': 'req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.534887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] The token cache is being invalidate because project 3008694e822a4edf8bbf3462e8dfc384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:42.535767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.535944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.537446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1188/2404] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:42 2022] DELETE /identity/v3/projects/3008694e822a4edf8bbf3462e8dfc384 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:42.542055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:42.543565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:42.558014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b77a1-0e2b-4bae-85a4-9440d8e36b2c admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:42.618738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:42.619421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:42.619702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:42.620007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] PATH_INFO: `/v3/users/f633188459bc423881bf26432d5a7963` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:42.623326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f633188459bc423881bf26432d5a7963)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:42.623486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:42.649732 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:42.829980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f633188459bc423881bf26432d5a7963'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.829980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f633188459bc423881bf26432d5a7963'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.829980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f633188459bc423881bf26432d5a7963'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.911804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f633188459bc423881bf26432d5a7963'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.925264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-d109edec-14ca-4cc0-8b59-e70ae9773c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f633188459bc423881bf26432d5a7963'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:42.938407 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1217/2405] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:42 2022] DELETE /identity/v3/users/f633188459bc423881bf26432d5a7963 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:43.199068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.200843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:43.215524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7704d-a4b1-4ec6-8f49-7ca6efbd38f2 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.276785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.277458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.277691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.277965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] PATH_INFO: `/v3/projects/1903cd3f5c2042869f39adc85ac1f9b8` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.279160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1903cd3f5c2042869f39adc85ac1f9b8)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.281144 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.363575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:43.375473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1903cd3f5c2042869f39adc85ac1f9b8', 'request_id': 'req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:43.448628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1903cd3f5c2042869f39adc85ac1f9b8', 'request_id': 'req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:43.455913 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1903cd3f5c2042869f39adc85ac1f9b8', 'request_id': 'req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:43.467735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] The token cache is being invalidate because project 1903cd3f5c2042869f39adc85ac1f9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:43.468041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:43.468728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-58047fc9-729d-4fe9-8ab3-a0eec8e1e75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:43.473646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1189/2406] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:43 2022] DELETE /identity/v3/projects/1903cd3f5c2042869f39adc85ac1f9b8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:43.476469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3913691-80d9-4f4b-a12e-35ef8ebaf534 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.476469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3913691-80d9-4f4b-a12e-35ef8ebaf534 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.486058 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3913691-80d9-4f4b-a12e-35ef8ebaf534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.497739 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c3913691-80d9-4f4b-a12e-35ef8ebaf534 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:43.499009 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c3913691-80d9-4f4b-a12e-35ef8ebaf534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:43.562859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1218/2407] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:43.572824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65d78f-1756-4042-beb1-a6c2fc66446c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.572824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65d78f-1756-4042-beb1-a6c2fc66446c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.572824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65d78f-1756-4042-beb1-a6c2fc66446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.591866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-5a65d78f-1756-4042-beb1-a6c2fc66446c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:43.593081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5a65d78f-1756-4042-beb1-a6c2fc66446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:43.601665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1190/2408] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:43.605892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3913691-80d9-4f4b-a12e-35ef8ebaf534 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.615591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3913691-80d9-4f4b-a12e-35ef8ebaf534 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.620766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7ac5-a697-4dbc-a841-61866a08be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.621404 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7ac5-a697-4dbc-a841-61866a08be1e admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.621681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7ac5-a697-4dbc-a841-61866a08be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.621960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7ac5-a697-4dbc-a841-61866a08be1e admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.622608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee7ac5-a697-4dbc-a841-61866a08be1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:57:43.622909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee7ac5-a697-4dbc-a841-61866a08be1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.624593 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee7ac5-a697-4dbc-a841-61866a08be1e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.640170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1219/2409] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:57:43.641271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65d78f-1756-4042-beb1-a6c2fc66446c None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.651526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65d78f-1756-4042-beb1-a6c2fc66446c None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.656512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8c61d-b596-4e16-bc2d-f0ea1562b77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.657124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8c61d-b596-4e16-bc2d-f0ea1562b77f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.657409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8c61d-b596-4e16-bc2d-f0ea1562b77f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.657692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8c61d-b596-4e16-bc2d-f0ea1562b77f admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.658307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8c61d-b596-4e16-bc2d-f0ea1562b77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.660349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8c61d-b596-4e16-bc2d-f0ea1562b77f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.743659 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1191/2410] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:57:43.747483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7ac5-a697-4dbc-a841-61866a08be1e admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.759441 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7ac5-a697-4dbc-a841-61866a08be1e admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.840798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2557c6a-e5de-4fee-a73c-b35eed4c1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.841552 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557c6a-e5de-4fee-a73c-b35eed4c1183 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.841936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557c6a-e5de-4fee-a73c-b35eed4c1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.842318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557c6a-e5de-4fee-a73c-b35eed4c1183 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.843180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2557c6a-e5de-4fee-a73c-b35eed4c1183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.845295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2557c6a-e5de-4fee-a73c-b35eed4c1183 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:43.891253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054408c-34d9-4f1b-b87c-85a9a62d2a3f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.891687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054408c-34d9-4f1b-b87c-85a9a62d2a3f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.891978 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054408c-34d9-4f1b-b87c-85a9a62d2a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.918502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-7054408c-34d9-4f1b-b87c-85a9a62d2a3f None None] MFA Rules not processed for user `c51868a65e084f738b380535f315030f`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:43.919763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7054408c-34d9-4f1b-b87c-85a9a62d2a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:43.969260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1220/2411] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:57:43.972941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2557c6a-e5de-4fee-a73c-b35eed4c1183 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:43.977809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1192/2412] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:43.983396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2557c6a-e5de-4fee-a73c-b35eed4c1183 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:43.988143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cebd21-396a-4d20-82b5-3a4f4ad9f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:43.988744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebd21-396a-4d20-82b5-3a4f4ad9f269 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.989027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebd21-396a-4d20-82b5-3a4f4ad9f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.989308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebd21-396a-4d20-82b5-3a4f4ad9f269 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.990134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cebd21-396a-4d20-82b5-3a4f4ad9f269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:43.991813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cebd21-396a-4d20-82b5-3a4f4ad9f269 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:44.005660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1221/2413] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:57:44.007509 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054408c-34d9-4f1b-b87c-85a9a62d2a3f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:44.019191 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054408c-34d9-4f1b-b87c-85a9a62d2a3f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:44.024874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca608a-6cbb-4017-ba6b-0ec6056efe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:44.025493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca608a-6cbb-4017-ba6b-0ec6056efe58 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:44.025922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca608a-6cbb-4017-ba6b-0ec6056efe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:44.026207 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca608a-6cbb-4017-ba6b-0ec6056efe58 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:44.026858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca608a-6cbb-4017-ba6b-0ec6056efe58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:44.028524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca608a-6cbb-4017-ba6b-0ec6056efe58 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:44.042599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1193/2414] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:44.048917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cebd21-396a-4d20-82b5-3a4f4ad9f269 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:44.058284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:44.062227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cebd21-396a-4d20-82b5-3a4f4ad9f269 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:44.067279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcac0ff-8621-4d8e-8ff7-cfed807809d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:44.070433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcac0ff-8621-4d8e-8ff7-cfed807809d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:44.070433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcac0ff-8621-4d8e-8ff7-cfed807809d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:44.070433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcac0ff-8621-4d8e-8ff7-cfed807809d8 admin admin] PATH_INFO: `/v3/projects/0446f520a51349ccabd8382b5d2d03d6/users/168ff5f176424c8389ec24e75ef3d6fc/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:44.084835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcac0ff-8621-4d8e-8ff7-cfed807809d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0446f520a51349ccabd8382b5d2d03d6, user_id=168ff5f176424c8389ec24e75ef3d6fc, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:44.087598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcac0ff-8621-4d8e-8ff7-cfed807809d8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:44.155039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1222/2415] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:57:44 2022] PUT /identity/v3/projects/0446f520a51349ccabd8382b5d2d03d6/users/168ff5f176424c8389ec24e75ef3d6fc/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:44.165632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e365d-c9fc-4e7f-ad71-54c76e4b9804 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:44.165984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e365d-c9fc-4e7f-ad71-54c76e4b9804 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:44.166264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e365d-c9fc-4e7f-ad71-54c76e4b9804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:44.209184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-cc4e365d-c9fc-4e7f-ad71-54c76e4b9804 None None] MFA Rules not processed for user `168ff5f176424c8389ec24e75ef3d6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:44.210773 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cc4e365d-c9fc-4e7f-ad71-54c76e4b9804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.265557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcac0ff-8621-4d8e-8ff7-cfed807809d8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:44.267644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5bcac0ff-8621-4d8e-8ff7-cfed807809d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.291567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1194/2416] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:44.302538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e365d-c9fc-4e7f-ad71-54c76e4b9804 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:44.304507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cc4e365d-c9fc-4e7f-ad71-54c76e4b9804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.332100 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:44.355003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcac0ff-8621-4d8e-8ff7-cfed807809d8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:44.362982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03de99-c930-4544-9908-bb537389b27c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:44.363647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03de99-c930-4544-9908-bb537389b27c service placement] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:44.363933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03de99-c930-4544-9908-bb537389b27c service placement] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:44.364227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03de99-c930-4544-9908-bb537389b27c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:44.366640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6e03de99-c930-4544-9908-bb537389b27c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.381952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03de99-c930-4544-9908-bb537389b27c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:44.381952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03de99-c930-4544-9908-bb537389b27c service placement] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:44.393429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1223/2417] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:57:44.398375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e365d-c9fc-4e7f-ad71-54c76e4b9804 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:44.403029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17623ce-d4fc-4ab1-b3fd-f386d2da5d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:44.403755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17623ce-d4fc-4ab1-b3fd-f386d2da5d9e service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:44.404096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17623ce-d4fc-4ab1-b3fd-f386d2da5d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:44.404440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17623ce-d4fc-4ab1-b3fd-f386d2da5d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:44.414903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17623ce-d4fc-4ab1-b3fd-f386d2da5d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:44.416423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17623ce-d4fc-4ab1-b3fd-f386d2da5d9e service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:44.425690 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1195/2418] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:57:50.539497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03de99-c930-4544-9908-bb537389b27c service placement] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:50.602861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03de99-c930-4544-9908-bb537389b27c service placement] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:50.603093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:50.603751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:50.604054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:50.604340 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] PATH_INFO: `/v3/users/168ff5f176424c8389ec24e75ef3d6fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:50.605457 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=168ff5f176424c8389ec24e75ef3d6fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:50.607373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:50.793983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168ff5f176424c8389ec24e75ef3d6fc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.794640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168ff5f176424c8389ec24e75ef3d6fc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.795270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168ff5f176424c8389ec24e75ef3d6fc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.876737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168ff5f176424c8389ec24e75ef3d6fc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.889713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168ff5f176424c8389ec24e75ef3d6fc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:50.890910 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:50.903178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1224/2419] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:50 2022] DELETE /identity/v3/users/168ff5f176424c8389ec24e75ef3d6fc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:57:50.907989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f1d8-4bce-4d87-b924-8c9d07bb0f73 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:50.908491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f1d8-4bce-4d87-b924-8c9d07bb0f73 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:50.908610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94f1d8-4bce-4d87-b924-8c9d07bb0f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:50.928256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ed94f1d8-4bce-4d87-b924-8c9d07bb0f73 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:50.929593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ed94f1d8-4bce-4d87-b924-8c9d07bb0f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:50.991603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1196/2420] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:51.002141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:51.003582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:51.064923 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05099c4-3789-4ae2-b381-aee1f3ed5101 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:51.068356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e085f2-909a-40e8-a734-b1df5e17aac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:51.068970 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e085f2-909a-40e8-a734-b1df5e17aac3 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:51.069253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e085f2-909a-40e8-a734-b1df5e17aac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:51.069536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e085f2-909a-40e8-a734-b1df5e17aac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:51.080377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e085f2-909a-40e8-a734-b1df5e17aac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:51.081913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e085f2-909a-40e8-a734-b1df5e17aac3 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:51.094889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1225/2421] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:57:51.535382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f1d8-4bce-4d87-b924-8c9d07bb0f73 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:51.537974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ed94f1d8-4bce-4d87-b924-8c9d07bb0f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:51.555345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94f1d8-4bce-4d87-b924-8c9d07bb0f73 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:51.562252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:51.563065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:51.566538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:51.566538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] PATH_INFO: `/v3/projects/0446f520a51349ccabd8382b5d2d03d6` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:51.566538 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0446f520a51349ccabd8382b5d2d03d6)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:51.567406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:51.771694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0446f520a51349ccabd8382b5d2d03d6', 'request_id': 'req-061b101f-3cd1-4ef7-9905-09aaae326eff'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:51.865492 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0446f520a51349ccabd8382b5d2d03d6', 'request_id': 'req-061b101f-3cd1-4ef7-9905-09aaae326eff'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:51.873136 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0446f520a51349ccabd8382b5d2d03d6', 'request_id': 'req-061b101f-3cd1-4ef7-9905-09aaae326eff'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:51.884438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] The token cache is being invalidate because project 0446f520a51349ccabd8382b5d2d03d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:57:51.884721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:51.885346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-061b101f-3cd1-4ef7-9905-09aaae326eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:51.886904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1197/2422] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:57:51 2022] DELETE /identity/v3/projects/0446f520a51349ccabd8382b5d2d03d6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:59.222023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e085f2-909a-40e8-a734-b1df5e17aac3 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:59.223492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-76e085f2-909a-40e8-a734-b1df5e17aac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:59.237186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e085f2-909a-40e8-a734-b1df5e17aac3 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:59.304595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:59.305285 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:59.305569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:59.305848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] PATH_INFO: `/v3/users/6b5be3881b204313865f939cacadd514` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:59.307082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5be3881b204313865f939cacadd514)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:59.309360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:59.473544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5be3881b204313865f939cacadd514'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:59.474199 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5be3881b204313865f939cacadd514'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:59.474798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5be3881b204313865f939cacadd514'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:59.539757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5be3881b204313865f939cacadd514'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:59.552333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5be3881b204313865f939cacadd514'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:57:59.565912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1226/2423] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:57:59 2022] DELETE /identity/v3/users/6b5be3881b204313865f939cacadd514 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:57:59.570413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ab3e3-2949-4ea0-b311-523a1bb71e2a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:59.570864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ab3e3-2949-4ea0-b311-523a1bb71e2a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:59.570956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ab3e3-2949-4ea0-b311-523a1bb71e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:59.590316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-f41ab3e3-2949-4ea0-b311-523a1bb71e2a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:59.591553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f41ab3e3-2949-4ea0-b311-523a1bb71e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:59.630375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:59.651432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1198/2424] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:59.660911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:59.662303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:59.676800 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:59.721121 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482d1a1-affd-4c75-9c2b-7baf7cd80bec admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:59.724833 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dc45c-f183-42d9-87c4-08975e202b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:59.725431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dc45c-f183-42d9-87c4-08975e202b8a service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:59.726213 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dc45c-f183-42d9-87c4-08975e202b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:59.726542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dc45c-f183-42d9-87c4-08975e202b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:59.735607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dc45c-f183-42d9-87c4-08975e202b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:59.737022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dc45c-f183-42d9-87c4-08975e202b8a service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:59.746889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1227/2425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:00.165120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ab3e3-2949-4ea0-b311-523a1bb71e2a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:00.166728 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f41ab3e3-2949-4ea0-b311-523a1bb71e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:00.179931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ab3e3-2949-4ea0-b311-523a1bb71e2a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:00.185381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:00.186201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:00.186632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:00.186911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] PATH_INFO: `/v3/projects/54059dd6af9d495192da6cb9822cf91c` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:00.188236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] RBAC: Authorizing `identity:delete_project(project_id=54059dd6af9d495192da6cb9822cf91c)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:00.190151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:00.306983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54059dd6af9d495192da6cb9822cf91c', 'request_id': 'req-abf6de51-8610-45ad-b99f-7e2ab7ee810d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:00.362226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54059dd6af9d495192da6cb9822cf91c', 'request_id': 'req-abf6de51-8610-45ad-b99f-7e2ab7ee810d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:00.369785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54059dd6af9d495192da6cb9822cf91c', 'request_id': 'req-abf6de51-8610-45ad-b99f-7e2ab7ee810d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:00.380718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] The token cache is being invalidate because project 54059dd6af9d495192da6cb9822cf91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:00.381131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:00.381804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:00.384116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1199/2426] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:00 2022] DELETE /identity/v3/projects/54059dd6af9d495192da6cb9822cf91c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:04.581668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee93742-cae7-48ff-8fa6-d53222326bac None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:04.582230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee93742-cae7-48ff-8fa6-d53222326bac None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:04.582230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee93742-cae7-48ff-8fa6-d53222326bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:04.602108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3ee93742-cae7-48ff-8fa6-d53222326bac None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:04.603314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3ee93742-cae7-48ff-8fa6-d53222326bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:04.661219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1228/2427] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:04.676843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:04.678207 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:04.752626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6de51-8610-45ad-b99f-7e2ab7ee810d admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:04.758190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9127d0-1c5f-4548-a74e-af0f10d1ec34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:04.758793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9127d0-1c5f-4548-a74e-af0f10d1ec34 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:04.759074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9127d0-1c5f-4548-a74e-af0f10d1ec34 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:04.759389 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9127d0-1c5f-4548-a74e-af0f10d1ec34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:04.769237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9127d0-1c5f-4548-a74e-af0f10d1ec34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:04.770874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9127d0-1c5f-4548-a74e-af0f10d1ec34 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:04.781220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1200/2428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:10.018784 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890b7c-3ded-47bc-9022-9556a04e7281 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:10.019473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890b7c-3ded-47bc-9022-9556a04e7281 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:10.019473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890b7c-3ded-47bc-9022-9556a04e7281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:10.038858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-07890b7c-3ded-47bc-9022-9556a04e7281 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:10.040143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-07890b7c-3ded-47bc-9022-9556a04e7281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:10.048378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1229/2429] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:10.062909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9127d0-1c5f-4548-a74e-af0f10d1ec34 service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:10.064682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2b9127d0-1c5f-4548-a74e-af0f10d1ec34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:10.080388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9127d0-1c5f-4548-a74e-af0f10d1ec34 service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:10.086135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de3190-e6a5-463d-ab5d-f415f4ecfe40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:10.086963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de3190-e6a5-463d-ab5d-f415f4ecfe40 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:10.087714 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de3190-e6a5-463d-ab5d-f415f4ecfe40 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:10.088044 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de3190-e6a5-463d-ab5d-f415f4ecfe40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:10.098387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de3190-e6a5-463d-ab5d-f415f4ecfe40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:10.100830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de3190-e6a5-463d-ab5d-f415f4ecfe40 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:10.110678 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1201/2430] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:14.782497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e08d5-d2a8-4c53-aead-3f5e5fbbafca None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:14.782961 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e08d5-d2a8-4c53-aead-3f5e5fbbafca None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:14.783111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e08d5-d2a8-4c53-aead-3f5e5fbbafca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:14.802556 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-642e08d5-d2a8-4c53-aead-3f5e5fbbafca None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:14.804314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-642e08d5-d2a8-4c53-aead-3f5e5fbbafca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:14.860786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1230/2431] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:58:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:14.884306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de3190-e6a5-463d-ab5d-f415f4ecfe40 service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:14.885505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-81de3190-e6a5-463d-ab5d-f415f4ecfe40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:14.939056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:14.970173 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de3190-e6a5-463d-ab5d-f415f4ecfe40 service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:14.976940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c33aa-7511-4b5e-be3f-490eb0b3b406 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:14.978980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c33aa-7511-4b5e-be3f-490eb0b3b406 service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:14.978980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c33aa-7511-4b5e-be3f-490eb0b3b406 service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:14.978980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c33aa-7511-4b5e-be3f-490eb0b3b406 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:14.989073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c33aa-7511-4b5e-be3f-490eb0b3b406 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:14.990727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c33aa-7511-4b5e-be3f-490eb0b3b406 service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:15.000511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1202/2432] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 07:58:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:58:15.126659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7c8e-2929-47c7-a55d-27d44b9e8392 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:15.127127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7c8e-2929-47c7-a55d-27d44b9e8392 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:15.128026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7c8e-2929-47c7-a55d-27d44b9e8392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:15.149821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d82c7c8e-2929-47c7-a55d-27d44b9e8392 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:15.151027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d82c7c8e-2929-47c7-a55d-27d44b9e8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:15.160231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1231/2433] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:15.178925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c33aa-7511-4b5e-be3f-490eb0b3b406 service swift] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:15.192577 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c33aa-7511-4b5e-be3f-490eb0b3b406 service swift] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:15.199640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4f014-9d6c-4bc9-939c-8170f1f5eb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:15.200489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f014-9d6c-4bc9-939c-8170f1f5eb56 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:15.200836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f014-9d6c-4bc9-939c-8170f1f5eb56 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:15.201535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f014-9d6c-4bc9-939c-8170f1f5eb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:15.210801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4f014-9d6c-4bc9-939c-8170f1f5eb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:15.212511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4f014-9d6c-4bc9-939c-8170f1f5eb56 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:15.223219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1203/2434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:15.263450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7c8e-2929-47c7-a55d-27d44b9e8392 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:15.265089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d82c7c8e-2929-47c7-a55d-27d44b9e8392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:15.279042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7c8e-2929-47c7-a55d-27d44b9e8392 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:15.287562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:15.287562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:15.287562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:15.287562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] PATH_INFO: `/v3/users/d845ed93cccb45038088a0f32f7aec34` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:15.288128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d845ed93cccb45038088a0f32f7aec34)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:15.291318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:15.498804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:15.505588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd845ed93cccb45038088a0f32f7aec34'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:15.506277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd845ed93cccb45038088a0f32f7aec34'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:15.506906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd845ed93cccb45038088a0f32f7aec34'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:15.557064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd845ed93cccb45038088a0f32f7aec34'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:15.578196 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd845ed93cccb45038088a0f32f7aec34'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:15.595479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1232/2435] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:15 2022] DELETE /identity/v3/users/d845ed93cccb45038088a0f32f7aec34 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:15.597315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21302d3-cb6d-43d9-a97d-9593f53e68b7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:15.597611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21302d3-cb6d-43d9-a97d-9593f53e68b7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:15.597912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21302d3-cb6d-43d9-a97d-9593f53e68b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:15.618867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-b21302d3-cb6d-43d9-a97d-9593f53e68b7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:15.620137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b21302d3-cb6d-43d9-a97d-9593f53e68b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:15.688350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1204/2436] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:15.698100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:15.700604 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:15.768411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb5fca-2d24-4924-b76b-d3977e4b4979 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:15.772253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78ee79-4021-43c4-87f1-f5983e4554e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:15.772897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78ee79-4021-43c4-87f1-f5983e4554e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:15.773183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78ee79-4021-43c4-87f1-f5983e4554e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:15.773460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78ee79-4021-43c4-87f1-f5983e4554e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:15.783893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78ee79-4021-43c4-87f1-f5983e4554e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:15.785333 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78ee79-4021-43c4-87f1-f5983e4554e3 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:15.798417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1233/2437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:16.382681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21302d3-cb6d-43d9-a97d-9593f53e68b7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:16.384794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b21302d3-cb6d-43d9-a97d-9593f53e68b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:16.401583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21302d3-cb6d-43d9-a97d-9593f53e68b7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:16.407685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:16.408585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:16.409068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:16.409801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] PATH_INFO: `/v3/projects/0f77a272d73f42e18af0e9eb060eb449` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:16.411183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f77a272d73f42e18af0e9eb060eb449)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:16.413337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:16.525671 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f77a272d73f42e18af0e9eb060eb449', 'request_id': 'req-c78ea597-b177-4577-a5b1-5628d36ea63a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.585138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f77a272d73f42e18af0e9eb060eb449', 'request_id': 'req-c78ea597-b177-4577-a5b1-5628d36ea63a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.592701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f77a272d73f42e18af0e9eb060eb449', 'request_id': 'req-c78ea597-b177-4577-a5b1-5628d36ea63a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.605239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] The token cache is being invalidate because project 0f77a272d73f42e18af0e9eb060eb449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:16.605561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.606251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c78ea597-b177-4577-a5b1-5628d36ea63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:16.608065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1205/2438] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:16 2022] DELETE /identity/v3/projects/0f77a272d73f42e18af0e9eb060eb449 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:16.612794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f9c7a-1016-40ab-a038-d663a56bdcbc None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:16.613460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f9c7a-1016-40ab-a038-d663a56bdcbc None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:16.613460 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f9c7a-1016-40ab-a038-d663a56bdcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:16.635365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-546f9c7a-1016-40ab-a038-d663a56bdcbc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:16.637074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-546f9c7a-1016-40ab-a038-d663a56bdcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:16.720955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1234/2439] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:16.729044 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd2eb6-62d3-4c2a-8422-5d9d42cdb955 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:16.729438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd2eb6-62d3-4c2a-8422-5d9d42cdb955 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:16.730486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd2eb6-62d3-4c2a-8422-5d9d42cdb955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:16.753499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6ffd2eb6-62d3-4c2a-8422-5d9d42cdb955 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:16.754862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6ffd2eb6-62d3-4c2a-8422-5d9d42cdb955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:16.763469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1206/2440] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:16.767891 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f9c7a-1016-40ab-a038-d663a56bdcbc None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:16.780483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f9c7a-1016-40ab-a038-d663a56bdcbc None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:16.785614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc1280-86dc-4243-876f-c580826b341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:16.786208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc1280-86dc-4243-876f-c580826b341a admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:16.786493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc1280-86dc-4243-876f-c580826b341a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:16.786771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc1280-86dc-4243-876f-c580826b341a admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:16.787455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc1280-86dc-4243-876f-c580826b341a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:16.787764 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc1280-86dc-4243-876f-c580826b341a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:16.789366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc1280-86dc-4243-876f-c580826b341a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:16.803097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1235/2441] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:16.808524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd2eb6-62d3-4c2a-8422-5d9d42cdb955 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:16.819219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd2eb6-62d3-4c2a-8422-5d9d42cdb955 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:16.824904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d477-8c0c-44c2-acc7-1cf7228ec28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:16.825604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d477-8c0c-44c2-acc7-1cf7228ec28d admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:16.825948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d477-8c0c-44c2-acc7-1cf7228ec28d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:16.826287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d477-8c0c-44c2-acc7-1cf7228ec28d admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:16.826977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6d477-8c0c-44c2-acc7-1cf7228ec28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:16.828975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6d477-8c0c-44c2-acc7-1cf7228ec28d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:16.918307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1207/2442] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:16.925040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc1280-86dc-4243-876f-c580826b341a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:16.940765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc1280-86dc-4243-876f-c580826b341a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:17.002660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:17.020992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020186-4b9b-453f-a011-b9b47ca83e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:17.021768 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020186-4b9b-453f-a011-b9b47ca83e5f admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:17.022227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020186-4b9b-453f-a011-b9b47ca83e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:17.022614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020186-4b9b-453f-a011-b9b47ca83e5f admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:17.023392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74020186-4b9b-453f-a011-b9b47ca83e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:17.027959 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74020186-4b9b-453f-a011-b9b47ca83e5f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:17.118672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1236/2443] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:16 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:17.123463 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d477-8c0c-44c2-acc7-1cf7228ec28d admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:17.136318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d477-8c0c-44c2-acc7-1cf7228ec28d admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:17.141171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eb2da-4b9d-4291-9e90-8115505a4edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:17.141888 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb2da-4b9d-4291-9e90-8115505a4edb admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:17.142640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb2da-4b9d-4291-9e90-8115505a4edb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:17.142640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eb2da-4b9d-4291-9e90-8115505a4edb admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:17.142979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eb2da-4b9d-4291-9e90-8115505a4edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:17.144624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eb2da-4b9d-4291-9e90-8115505a4edb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:17.146994 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:17.156521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1208/2444] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:17.162374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020186-4b9b-453f-a011-b9b47ca83e5f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:17.174946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020186-4b9b-453f-a011-b9b47ca83e5f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:17.181551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1267b-d193-419f-907c-ad62fba38246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:17.182291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1267b-d193-419f-907c-ad62fba38246 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:17.183195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1267b-d193-419f-907c-ad62fba38246 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:17.183594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1267b-d193-419f-907c-ad62fba38246 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:17.185354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1267b-d193-419f-907c-ad62fba38246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:17.186368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1267b-d193-419f-907c-ad62fba38246 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:17.203706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1237/2445] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:17.206128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eb2da-4b9d-4291-9e90-8115505a4edb admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:17.217013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eb2da-4b9d-4291-9e90-8115505a4edb admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:17.221899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9f1ec-200f-4005-91df-af442f352626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:17.226222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9f1ec-200f-4005-91df-af442f352626 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:17.226222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9f1ec-200f-4005-91df-af442f352626 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:17.226222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9f1ec-200f-4005-91df-af442f352626 admin admin] PATH_INFO: `/v3/projects/8e2a2a09f8ad439a9975d0e24d3a64ce/users/fe8262487c114d6cbf57b5470f719133/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:17.241418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9f1ec-200f-4005-91df-af442f352626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2a2a09f8ad439a9975d0e24d3a64ce, user_id=fe8262487c114d6cbf57b5470f719133, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:17.245791 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9f1ec-200f-4005-91df-af442f352626 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:17.324962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1209/2446] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:17 2022] PUT /identity/v3/projects/8e2a2a09f8ad439a9975d0e24d3a64ce/users/fe8262487c114d6cbf57b5470f719133/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:17.327068 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5a422-1951-4e7b-a0dd-9801f4dc6f0d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:17.327448 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5a422-1951-4e7b-a0dd-9801f4dc6f0d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:17.327793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5a422-1951-4e7b-a0dd-9801f4dc6f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:17.390509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-5cc5a422-1951-4e7b-a0dd-9801f4dc6f0d None None] MFA Rules not processed for user `fe8262487c114d6cbf57b5470f719133`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:17.393040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5cc5a422-1951-4e7b-a0dd-9801f4dc6f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:17.526612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1238/2447] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:17.541374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9f1ec-200f-4005-91df-af442f352626 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:17.545364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-53b9f1ec-200f-4005-91df-af442f352626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:17.629092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9f1ec-200f-4005-91df-af442f352626 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:17.632833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2df03-2df6-40fd-a68f-8dce7f999888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:17.633441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2df03-2df6-40fd-a68f-8dce7f999888 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:17.633719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2df03-2df6-40fd-a68f-8dce7f999888 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:17.633990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2df03-2df6-40fd-a68f-8dce7f999888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:17.644602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2df03-2df6-40fd-a68f-8dce7f999888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:17.646058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2df03-2df6-40fd-a68f-8dce7f999888 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:17.656298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1210/2448] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:20.482628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d581-e805-4b90-84e9-19855d064de4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.483147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d581-e805-4b90-84e9-19855d064de4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.483257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d581-e805-4b90-84e9-19855d064de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.511912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f2b9d581-e805-4b90-84e9-19855d064de4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:20.513508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f2b9d581-e805-4b90-84e9-19855d064de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:20.630183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1239/2449] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:20.653228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2df03-2df6-40fd-a68f-8dce7f999888 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:20.655190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-02c2df03-2df6-40fd-a68f-8dce7f999888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:20.767882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2df03-2df6-40fd-a68f-8dce7f999888 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:20.776423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f718eb4-f502-4abc-8729-f55d24d0ba8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:20.777295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f718eb4-f502-4abc-8729-f55d24d0ba8e service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:20.777657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f718eb4-f502-4abc-8729-f55d24d0ba8e service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:20.778018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f718eb4-f502-4abc-8729-f55d24d0ba8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:20.787628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f718eb4-f502-4abc-8729-f55d24d0ba8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:20.789337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f718eb4-f502-4abc-8729-f55d24d0ba8e service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:20.800588 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1211/2450] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:24.865753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a8ee-67a5-4f07-a6d5-7f91285280f2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:24.866306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a8ee-67a5-4f07-a6d5-7f91285280f2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:24.866579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a8ee-67a5-4f07-a6d5-7f91285280f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:24.905452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ad64a8ee-67a5-4f07-a6d5-7f91285280f2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:24.906726 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ad64a8ee-67a5-4f07-a6d5-7f91285280f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:24.919278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1240/2451] 10.222.0.61 () {58 vars in 1016 bytes} [Wed Aug 24 07:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:24.952320 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f718eb4-f502-4abc-8729-f55d24d0ba8e service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:24.954295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7f718eb4-f502-4abc-8729-f55d24d0ba8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:24.974726 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f718eb4-f502-4abc-8729-f55d24d0ba8e service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:24.982152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da434bbb-3db6-49d9-b2d7-dc1480f30202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:24.982809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da434bbb-3db6-49d9-b2d7-dc1480f30202 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:24.983091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da434bbb-3db6-49d9-b2d7-dc1480f30202 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:24.983498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da434bbb-3db6-49d9-b2d7-dc1480f30202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:24.993005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da434bbb-3db6-49d9-b2d7-dc1480f30202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:24.994624 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da434bbb-3db6-49d9-b2d7-dc1480f30202 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:25.005088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1212/2452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:30.555734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a8ee-67a5-4f07-a6d5-7f91285280f2 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:30.566783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a8ee-67a5-4f07-a6d5-7f91285280f2 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:30.571227 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:30.571877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:30.572164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:30.572431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] PATH_INFO: `/v3/users/fe8262487c114d6cbf57b5470f719133` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:30.573554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8262487c114d6cbf57b5470f719133)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:30.575765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:30.759816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:30.761567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8262487c114d6cbf57b5470f719133'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.762231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8262487c114d6cbf57b5470f719133'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.762909 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8262487c114d6cbf57b5470f719133'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.807913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8262487c114d6cbf57b5470f719133'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.822443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8262487c114d6cbf57b5470f719133'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:30.834978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1241/2453] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:58:30 2022] DELETE /identity/v3/users/fe8262487c114d6cbf57b5470f719133 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:30.839655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ce3d5-bfa0-4afd-ac00-1f7c4e4a7a56 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:30.840116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ce3d5-bfa0-4afd-ac00-1f7c4e4a7a56 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:30.840210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ce3d5-bfa0-4afd-ac00-1f7c4e4a7a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:30.861104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-730ce3d5-bfa0-4afd-ac00-1f7c4e4a7a56 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:30.862371 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-730ce3d5-bfa0-4afd-ac00-1f7c4e4a7a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:30.905605 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:30.922165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1213/2454] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:30.940740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:30.940740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:30.993383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb745-b2a4-4e3e-9b22-41d444afd87d admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:30.997149 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28863d-3121-4122-b809-34087620941b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:30.997766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28863d-3121-4122-b809-34087620941b service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:30.998092 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28863d-3121-4122-b809-34087620941b service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:30.998366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28863d-3121-4122-b809-34087620941b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.007592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28863d-3121-4122-b809-34087620941b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:31.009113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28863d-3121-4122-b809-34087620941b service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:31.019536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1242/2455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:31.415280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ce3d5-bfa0-4afd-ac00-1f7c4e4a7a56 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:31.416736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-730ce3d5-bfa0-4afd-ac00-1f7c4e4a7a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:31.429134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ce3d5-bfa0-4afd-ac00-1f7c4e4a7a56 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:31.433864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:31.434786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:31.435079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:31.441323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] PATH_INFO: `/v3/projects/8e2a2a09f8ad439a9975d0e24d3a64ce` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.441323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2a2a09f8ad439a9975d0e24d3a64ce)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:31.441323 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:31.552548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2a2a09f8ad439a9975d0e24d3a64ce', 'request_id': 'req-1df0a5bd-5e13-4208-991d-ef258cd90933'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.601955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2a2a09f8ad439a9975d0e24d3a64ce', 'request_id': 'req-1df0a5bd-5e13-4208-991d-ef258cd90933'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.608979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2a2a09f8ad439a9975d0e24d3a64ce', 'request_id': 'req-1df0a5bd-5e13-4208-991d-ef258cd90933'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.619610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] The token cache is being invalidate because project 8e2a2a09f8ad439a9975d0e24d3a64ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:58:31.619900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.620560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1df0a5bd-5e13-4208-991d-ef258cd90933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:58:31.622553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1214/2456] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:58:31 2022] DELETE /identity/v3/projects/8e2a2a09f8ad439a9975d0e24d3a64ce => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:31.630821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ddd57-601a-4d02-be2d-5825c59ce7fb None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:31.631302 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ddd57-601a-4d02-be2d-5825c59ce7fb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:31.631400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ddd57-601a-4d02-be2d-5825c59ce7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.656774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-530ddd57-601a-4d02-be2d-5825c59ce7fb None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:31.658057 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-530ddd57-601a-4d02-be2d-5825c59ce7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:31.733410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1243/2457] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:31.743089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75346-cf6b-41d7-b5eb-a1ee749ba816 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:31.743420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75346-cf6b-41d7-b5eb-a1ee749ba816 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:31.743704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75346-cf6b-41d7-b5eb-a1ee749ba816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.767927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-59e75346-cf6b-41d7-b5eb-a1ee749ba816 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:31.769262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-59e75346-cf6b-41d7-b5eb-a1ee749ba816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:31.778018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1215/2458] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:31.782954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ddd57-601a-4d02-be2d-5825c59ce7fb None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:31.796497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ddd57-601a-4d02-be2d-5825c59ce7fb None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:31.804286 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e859315-ac2b-4d76-98ac-4214dff94020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:31.804931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e859315-ac2b-4d76-98ac-4214dff94020 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:31.805242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e859315-ac2b-4d76-98ac-4214dff94020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:31.805541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e859315-ac2b-4d76-98ac-4214dff94020 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.806207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e859315-ac2b-4d76-98ac-4214dff94020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:58:31.806511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e859315-ac2b-4d76-98ac-4214dff94020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:31.808185 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e859315-ac2b-4d76-98ac-4214dff94020 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:31.830774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1244/2459] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 07:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:58:31.832108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75346-cf6b-41d7-b5eb-a1ee749ba816 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:31.842390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75346-cf6b-41d7-b5eb-a1ee749ba816 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:31.847276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acce98-ddd8-407f-bbcd-4b792826b4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:31.847942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acce98-ddd8-407f-bbcd-4b792826b4ee admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:31.848226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acce98-ddd8-407f-bbcd-4b792826b4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:31.848502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acce98-ddd8-407f-bbcd-4b792826b4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:31.850378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acce98-ddd8-407f-bbcd-4b792826b4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:31.852358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acce98-ddd8-407f-bbcd-4b792826b4ee admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:31.962313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1216/2460] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:31 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:31.967560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e859315-ac2b-4d76-98ac-4214dff94020 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:31.987805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e859315-ac2b-4d76-98ac-4214dff94020 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.053974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:32.065081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dd79b-76dd-4425-8b68-b2783df183e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.070343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd79b-76dd-4425-8b68-b2783df183e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.070343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd79b-76dd-4425-8b68-b2783df183e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.070343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd79b-76dd-4425-8b68-b2783df183e6 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.070343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dd79b-76dd-4425-8b68-b2783df183e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.070343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dd79b-76dd-4425-8b68-b2783df183e6 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.158155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1245/2461] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:31 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:32.163241 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acce98-ddd8-407f-bbcd-4b792826b4ee admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.176071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acce98-ddd8-407f-bbcd-4b792826b4ee admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.181964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517d429-e36e-48e4-b4af-3456354ab2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.182663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517d429-e36e-48e4-b4af-3456354ab2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.183461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517d429-e36e-48e4-b4af-3456354ab2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.183461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517d429-e36e-48e4-b4af-3456354ab2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.184308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517d429-e36e-48e4-b4af-3456354ab2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.187590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517d429-e36e-48e4-b4af-3456354ab2b7 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.203747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1217/2462] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:32.209926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dd79b-76dd-4425-8b68-b2783df183e6 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.221394 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dd79b-76dd-4425-8b68-b2783df183e6 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.227549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b4f8f-dfea-4053-9e8d-0677efc1bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.228172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b4f8f-dfea-4053-9e8d-0677efc1bcbd admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.228458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b4f8f-dfea-4053-9e8d-0677efc1bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.228754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b4f8f-dfea-4053-9e8d-0677efc1bcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.229490 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b4f8f-dfea-4053-9e8d-0677efc1bcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.231253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b4f8f-dfea-4053-9e8d-0677efc1bcbd admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.246163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1246/2463] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:58:32.251769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517d429-e36e-48e4-b4af-3456354ab2b7 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.270838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517d429-e36e-48e4-b4af-3456354ab2b7 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.278806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0112a-a2d3-447e-95f4-3802b4098b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.278806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0112a-a2d3-447e-95f4-3802b4098b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.278806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0112a-a2d3-447e-95f4-3802b4098b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.278806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0112a-a2d3-447e-95f4-3802b4098b70 admin admin] PATH_INFO: `/v3/projects/74a3f469696a4792ba12f2ec03c304b6/users/552b00dcd3404a77a929384de9faafec/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.324718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0112a-a2d3-447e-95f4-3802b4098b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a3f469696a4792ba12f2ec03c304b6, user_id=552b00dcd3404a77a929384de9faafec, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.324718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0112a-a2d3-447e-95f4-3802b4098b70 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.483043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1218/2464] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:32 2022] PUT /identity/v3/projects/74a3f469696a4792ba12f2ec03c304b6/users/552b00dcd3404a77a929384de9faafec/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:32.490179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c4a53-09de-4b2f-b719-dd751f2c0f1f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.490470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c4a53-09de-4b2f-b719-dd751f2c0f1f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.490814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c4a53-09de-4b2f-b719-dd751f2c0f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.516073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ab8c4a53-09de-4b2f-b719-dd751f2c0f1f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:32.517514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ab8c4a53-09de-4b2f-b719-dd751f2c0f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:32.599924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1247/2465] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:32.612789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0112a-a2d3-447e-95f4-3802b4098b70 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:32.615095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9fe0112a-a2d3-447e-95f4-3802b4098b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:32.699745 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0112a-a2d3-447e-95f4-3802b4098b70 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:32.704086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8bb1d-ad86-4e68-88f8-0d867f8ef41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:32.704699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8bb1d-ad86-4e68-88f8-0d867f8ef41c service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:32.705010 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8bb1d-ad86-4e68-88f8-0d867f8ef41c service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:32.705283 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8bb1d-ad86-4e68-88f8-0d867f8ef41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:32.714518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8bb1d-ad86-4e68-88f8-0d867f8ef41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:32.716602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8bb1d-ad86-4e68-88f8-0d867f8ef41c service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:32.726116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1219/2466] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:33.720872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c229c6-56e2-41b2-a4a1-8b0b910fc7fe None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:33.721427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c229c6-56e2-41b2-a4a1-8b0b910fc7fe None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:33.721532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c229c6-56e2-41b2-a4a1-8b0b910fc7fe None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:33.723016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1248/2467] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:58:33.728899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e663ecb-47fc-4a77-9287-71a3e4f96d86 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:33.729379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e663ecb-47fc-4a77-9287-71a3e4f96d86 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:33.729473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e663ecb-47fc-4a77-9287-71a3e4f96d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:33.750700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-4e663ecb-47fc-4a77-9287-71a3e4f96d86 None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:33.752220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4e663ecb-47fc-4a77-9287-71a3e4f96d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:33.757899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:33.838351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1220/2468] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:58:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:33.849560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c229c6-56e2-41b2-a4a1-8b0b910fc7fe None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:33.856821 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a4c229c6-56e2-41b2-a4a1-8b0b910fc7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:33.910626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c229c6-56e2-41b2-a4a1-8b0b910fc7fe None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:33.914172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b346465-b613-4ea3-a81c-a44ee7096480 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f436ac7cc2f04919bb0ec1ad9fca5622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:33.914816 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346465-b613-4ea3-a81c-a44ee7096480 service glance] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:33.915103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346465-b613-4ea3-a81c-a44ee7096480 service glance] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:33.915408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346465-b613-4ea3-a81c-a44ee7096480 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:33.926592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b346465-b613-4ea3-a81c-a44ee7096480 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:33.928090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b346465-b613-4ea3-a81c-a44ee7096480 service glance] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:33.939951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1249/2469] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:34.147247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c99ec2-d76d-4939-a3a1-854f65d47107 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:34.148427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c99ec2-d76d-4939-a3a1-854f65d47107 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:34.148427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c99ec2-d76d-4939-a3a1-854f65d47107 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:34.149217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1221/2470] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:58:34.154261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cb2fc-6b97-42ea-9b06-d8a51ac7d7ba None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:34.154566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cb2fc-6b97-42ea-9b06-d8a51ac7d7ba None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:34.154846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cb2fc-6b97-42ea-9b06-d8a51ac7d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:34.176926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-394cb2fc-6b97-42ea-9b06-d8a51ac7d7ba None None] MFA Rules not processed for user `a4403ef0835a4d658f8eb50fac0780eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:34.176926 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-394cb2fc-6b97-42ea-9b06-d8a51ac7d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:34.191454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1250/2471] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:58:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:58:34.206708 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c99ec2-d76d-4939-a3a1-854f65d47107 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:34.208789 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-31c99ec2-d76d-4939-a3a1-854f65d47107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:34.224517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c99ec2-d76d-4939-a3a1-854f65d47107 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:34.228870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d533c37-7f51-4f96-a2fb-ababc8d9fedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:34.229700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d533c37-7f51-4f96-a2fb-ababc8d9fedd service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:34.230199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d533c37-7f51-4f96-a2fb-ababc8d9fedd service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:34.230626 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d533c37-7f51-4f96-a2fb-ababc8d9fedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:34.240909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d533c37-7f51-4f96-a2fb-ababc8d9fedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:34.243189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d533c37-7f51-4f96-a2fb-ababc8d9fedd service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:34.255436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1222/2472] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:34.397250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6dd9-3814-4c86-81ae-8b8cfd54dbe9 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:34.397707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6dd9-3814-4c86-81ae-8b8cfd54dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:34.398160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6dd9-3814-4c86-81ae-8b8cfd54dbe9 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:34.400170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1251/2473] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 07:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:58:34.406946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581333d-7e4f-4e56-9439-c63bbabc32ab None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:34.407240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581333d-7e4f-4e56-9439-c63bbabc32ab None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:34.412209 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581333d-7e4f-4e56-9439-c63bbabc32ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:34.431484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2581333d-7e4f-4e56-9439-c63bbabc32ab None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:34.434108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2581333d-7e4f-4e56-9439-c63bbabc32ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:34.447149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1223/2474] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 07:58:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:34.458925 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6dd9-3814-4c86-81ae-8b8cfd54dbe9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:34.470606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6dd9-3814-4c86-81ae-8b8cfd54dbe9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:34.475154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011013a5-6613-4599-991a-afa8b83552ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:34.475896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011013a5-6613-4599-991a-afa8b83552ed service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:34.476271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011013a5-6613-4599-991a-afa8b83552ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:34.476647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011013a5-6613-4599-991a-afa8b83552ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:34.488969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011013a5-6613-4599-991a-afa8b83552ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:34.490421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011013a5-6613-4599-991a-afa8b83552ed service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:34.502576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1252/2475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:39.397798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9769cb-a47e-46c2-b0ab-5c3d2e457318 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.398350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9769cb-a47e-46c2-b0ab-5c3d2e457318 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.398547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9769cb-a47e-46c2-b0ab-5c3d2e457318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.429747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6f9769cb-a47e-46c2-b0ab-5c3d2e457318 None None] MFA Rules not processed for user `552b00dcd3404a77a929384de9faafec`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:39.430944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6f9769cb-a47e-46c2-b0ab-5c3d2e457318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:39.496299 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1224/2476] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:39.501374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011013a5-6613-4599-991a-afa8b83552ed service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.515310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011013a5-6613-4599-991a-afa8b83552ed service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.525345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a793d-068a-41a6-8b99-e869194f7442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.527640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a793d-068a-41a6-8b99-e869194f7442 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.527640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a793d-068a-41a6-8b99-e869194f7442 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.527640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a793d-068a-41a6-8b99-e869194f7442 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.527640 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a793d-068a-41a6-8b99-e869194f7442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.529243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a793d-068a-41a6-8b99-e869194f7442 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.640352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1253/2477] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 07:58:39 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:58:39.644523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9769cb-a47e-46c2-b0ab-5c3d2e457318 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.664995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9769cb-a47e-46c2-b0ab-5c3d2e457318 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.740685 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642414d-60f1-4c2a-8b24-deb190e4ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.741316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642414d-60f1-4c2a-8b24-deb190e4ceae admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.741598 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642414d-60f1-4c2a-8b24-deb190e4ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.741874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642414d-60f1-4c2a-8b24-deb190e4ceae admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.742909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642414d-60f1-4c2a-8b24-deb190e4ceae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.745070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642414d-60f1-4c2a-8b24-deb190e4ceae admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.862123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1225/2478] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 07:58:39 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:58:39.865021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a793d-068a-41a6-8b99-e869194f7442 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.876379 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a793d-068a-41a6-8b99-e869194f7442 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.883432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cb282-c4a3-461a-9e22-074e4e2657f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.884428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cb282-c4a3-461a-9e22-074e4e2657f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.885001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cb282-c4a3-461a-9e22-074e4e2657f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.885444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cb282-c4a3-461a-9e22-074e4e2657f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.886355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670cb282-c4a3-461a-9e22-074e4e2657f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.891445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670cb282-c4a3-461a-9e22-074e4e2657f4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:39.909189 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642414d-60f1-4c2a-8b24-deb190e4ceae admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:39.910089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1254/2479] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:39.915308 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:39.925952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642414d-60f1-4c2a-8b24-deb190e4ceae admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:39.932873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9158f-0d1c-4a48-8271-b1568c9c2548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:39.933898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9158f-0d1c-4a48-8271-b1568c9c2548 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:39.938331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9158f-0d1c-4a48-8271-b1568c9c2548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:39.938331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9158f-0d1c-4a48-8271-b1568c9c2548 admin admin] PATH_INFO: `/v3/projects/61a2628b84444d9dadff75840d776013/users/cc35a5995da348a38d20f9b0529abb9f/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:39.953333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9158f-0d1c-4a48-8271-b1568c9c2548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a2628b84444d9dadff75840d776013, user_id=cc35a5995da348a38d20f9b0529abb9f, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:39.958108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9158f-0d1c-4a48-8271-b1568c9c2548 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:40.050976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1226/2480] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:39 2022] PUT /identity/v3/projects/61a2628b84444d9dadff75840d776013/users/cc35a5995da348a38d20f9b0529abb9f/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:40.054884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cb282-c4a3-461a-9e22-074e4e2657f4 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:40.067106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cb282-c4a3-461a-9e22-074e4e2657f4 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:40.098565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:40.169554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8748fe2-f60b-41ae-8942-8d8b53fb97e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:40.170220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8748fe2-f60b-41ae-8942-8d8b53fb97e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.170510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8748fe2-f60b-41ae-8942-8d8b53fb97e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.170783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8748fe2-f60b-41ae-8942-8d8b53fb97e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.171487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8748fe2-f60b-41ae-8942-8d8b53fb97e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:40.173097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8748fe2-f60b-41ae-8942-8d8b53fb97e4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:40.189799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1255/2481] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 07:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:58:40.191326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9158f-0d1c-4a48-8271-b1568c9c2548 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:40.204868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9158f-0d1c-4a48-8271-b1568c9c2548 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:40.211062 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ca8a1-74e9-498c-868e-1b48e316b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:40.211518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ca8a1-74e9-498c-868e-1b48e316b42b admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.211798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ca8a1-74e9-498c-868e-1b48e316b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.212065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ca8a1-74e9-498c-868e-1b48e316b42b admin admin] PATH_INFO: `/v3/projects/61a2628b84444d9dadff75840d776013/users/cc35a5995da348a38d20f9b0529abb9f/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.214915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ca8a1-74e9-498c-868e-1b48e316b42b admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a2628b84444d9dadff75840d776013, user_id=cc35a5995da348a38d20f9b0529abb9f, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:40.217781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ca8a1-74e9-498c-868e-1b48e316b42b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:40.231059 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1227/2482] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 07:58:40 2022] PUT /identity/v3/projects/61a2628b84444d9dadff75840d776013/users/cc35a5995da348a38d20f9b0529abb9f/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:58:40.914424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6da9-337d-434f-a2c1-756135c1b168 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:40.914958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6da9-337d-434f-a2c1-756135c1b168 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:40.916629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6da9-337d-434f-a2c1-756135c1b168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:40.937853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-319e6da9-337d-434f-a2c1-756135c1b168 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:40.937853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-319e6da9-337d-434f-a2c1-756135c1b168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:40.998258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1256/2483] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:58:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:41.013534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ca8a1-74e9-498c-868e-1b48e316b42b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:41.014344 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cd1ca8a1-74e9-498c-868e-1b48e316b42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:41.113282 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ca8a1-74e9-498c-868e-1b48e316b42b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:41.119903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b258e-c0e7-4343-a6e2-26b95fe18c90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:41.120660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b258e-c0e7-4343-a6e2-26b95fe18c90 service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:41.121000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b258e-c0e7-4343-a6e2-26b95fe18c90 service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:41.121335 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b258e-c0e7-4343-a6e2-26b95fe18c90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:41.130971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b258e-c0e7-4343-a6e2-26b95fe18c90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:41.132696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b258e-c0e7-4343-a6e2-26b95fe18c90 service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:41.142461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1228/2484] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 07:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:58:48.509612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417abc0-b51e-47e3-a803-2e08af310f7b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:48.510168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417abc0-b51e-47e3-a803-2e08af310f7b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:48.510252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417abc0-b51e-47e3-a803-2e08af310f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:48.596382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3417abc0-b51e-47e3-a803-2e08af310f7b None None] MFA Rules not processed for user `cc35a5995da348a38d20f9b0529abb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:48.597644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3417abc0-b51e-47e3-a803-2e08af310f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:48.688535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1257/2485] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:58:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:48.716996 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b258e-c0e7-4343-a6e2-26b95fe18c90 service swift] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:48.789616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b258e-c0e7-4343-a6e2-26b95fe18c90 service swift] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:48.795420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e373e6-4196-431a-b350-3d310c68eac4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f436ac7cc2f04919bb0ec1ad9fca5622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:48.795420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e373e6-4196-431a-b350-3d310c68eac4 service glance] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:48.795420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e373e6-4196-431a-b350-3d310c68eac4 service glance] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:48.795420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e373e6-4196-431a-b350-3d310c68eac4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:48.875199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e373e6-4196-431a-b350-3d310c68eac4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:48.876715 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e373e6-4196-431a-b350-3d310c68eac4 service glance] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:48.885792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1229/2486] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:58:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:58:49.180097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6d8f7-8f61-4a96-b684-f6be5e71d97c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:49.180386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6d8f7-8f61-4a96-b684-f6be5e71d97c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:49.180662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6d8f7-8f61-4a96-b684-f6be5e71d97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:49.209098 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ddd6d8f7-8f61-4a96-b684-f6be5e71d97c None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:58:49.212765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ddd6d8f7-8f61-4a96-b684-f6be5e71d97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:58:49.218911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1258/2487] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:58:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:58:49.237783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e373e6-4196-431a-b350-3d310c68eac4 service glance] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:58:49.258075 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e373e6-4196-431a-b350-3d310c68eac4 service glance] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:58:49.266202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89030cc4-15df-4ace-867c-935e0839cb4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:58:49.266949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89030cc4-15df-4ace-867c-935e0839cb4c service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:58:49.267833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89030cc4-15df-4ace-867c-935e0839cb4c service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:58:49.268261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89030cc4-15df-4ace-867c-935e0839cb4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:58:49.275550 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:49.279611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89030cc4-15df-4ace-867c-935e0839cb4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:58:49.281498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89030cc4-15df-4ace-867c-935e0839cb4c service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:58:49.290228 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1230/2488] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 07:58:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:58:59.203256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=81 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:59.444196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:01.176181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b792bdd-3af9-4791-b1de-dd93b64b356d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:01.176764 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b792bdd-3af9-4791-b1de-dd93b64b356d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:01.176764 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b792bdd-3af9-4791-b1de-dd93b64b356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:01.200956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-6b792bdd-3af9-4791-b1de-dd93b64b356d None None] MFA Rules not processed for user `552b00dcd3404a77a929384de9faafec`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:01.202187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6b792bdd-3af9-4791-b1de-dd93b64b356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:01.209404 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1259/2489] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:59:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:03.102105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dae5-0cd4-45da-a22d-10ce0de9429f None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:03.102632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dae5-0cd4-45da-a22d-10ce0de9429f None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:03.102751 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dae5-0cd4-45da-a22d-10ce0de9429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:03.123932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6112dae5-0cd4-45da-a22d-10ce0de9429f None None] MFA Rules not processed for user `601dc79382404e90a6acd32d118d13a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:03.125142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6112dae5-0cd4-45da-a22d-10ce0de9429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:03.187398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1231/2490] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:59:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:59:04.976062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee6191-baa1-4f1e-b45b-6d8113f3a066 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:04.976548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee6191-baa1-4f1e-b45b-6d8113f3a066 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:04.976642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee6191-baa1-4f1e-b45b-6d8113f3a066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:04.995809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-0dee6191-baa1-4f1e-b45b-6d8113f3a066 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:04.997471 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0dee6191-baa1-4f1e-b45b-6d8113f3a066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:05.004573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1260/2491] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 07:59:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:05.017289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112dae5-0cd4-45da-a22d-10ce0de9429f None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:05.031863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112dae5-0cd4-45da-a22d-10ce0de9429f None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:05.036114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badddd3e-27fd-42df-b84d-c193218433b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:05.036732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badddd3e-27fd-42df-b84d-c193218433b9 service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:05.037058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badddd3e-27fd-42df-b84d-c193218433b9 service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:05.037272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badddd3e-27fd-42df-b84d-c193218433b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:05.047488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badddd3e-27fd-42df-b84d-c193218433b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:05.049101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badddd3e-27fd-42df-b84d-c193218433b9 service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:05.067568 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1232/2492] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 07:59:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:59:06.308940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc522b0f-15df-48b5-aa63-7ff3868bbf88 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:06.309508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc522b0f-15df-48b5-aa63-7ff3868bbf88 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:06.309508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc522b0f-15df-48b5-aa63-7ff3868bbf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:06.351397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-bc522b0f-15df-48b5-aa63-7ff3868bbf88 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:06.352826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bc522b0f-15df-48b5-aa63-7ff3868bbf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:06.368031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1261/2493] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 07:59:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:06.381856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badddd3e-27fd-42df-b84d-c193218433b9 service swift] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:06.398877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badddd3e-27fd-42df-b84d-c193218433b9 service swift] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:06.406266 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e921fc-d46b-4168-b7ea-268f67fd5760 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:06.406962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e921fc-d46b-4168-b7ea-268f67fd5760 service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:06.407379 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e921fc-d46b-4168-b7ea-268f67fd5760 service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:06.407722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e921fc-d46b-4168-b7ea-268f67fd5760 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:06.417963 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e921fc-d46b-4168-b7ea-268f67fd5760 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:06.420792 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e921fc-d46b-4168-b7ea-268f67fd5760 service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:06.440382 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1233/2494] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 07:59:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:59:10.556950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc522b0f-15df-48b5-aa63-7ff3868bbf88 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:10.558409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bc522b0f-15df-48b5-aa63-7ff3868bbf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:10.628840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc522b0f-15df-48b5-aa63-7ff3868bbf88 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:10.636107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:10.636689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:10.636977 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:10.637284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] PATH_INFO: `/v3/users/c51868a65e084f738b380535f315030f` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:10.638493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51868a65e084f738b380535f315030f)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:10.640680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:10.860463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51868a65e084f738b380535f315030f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:10.861247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51868a65e084f738b380535f315030f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:10.861870 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51868a65e084f738b380535f315030f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:10.917097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51868a65e084f738b380535f315030f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:10.932601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51868a65e084f738b380535f315030f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:10.946321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1262/2495] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:10 2022] DELETE /identity/v3/users/c51868a65e084f738b380535f315030f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:11.204293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e921fc-d46b-4168-b7ea-268f67fd5760 service swift] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:11.219351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e921fc-d46b-4168-b7ea-268f67fd5760 service swift] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:11.311215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:11.312014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:11.312303 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:11.312583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] PATH_INFO: `/v3/projects/7777758be78a46b7b51b52c18d1cdd14` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:11.313834 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7777758be78a46b7b51b52c18d1cdd14)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:11.315771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:11.444706 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7777758be78a46b7b51b52c18d1cdd14', 'request_id': 'req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:11.522372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7777758be78a46b7b51b52c18d1cdd14', 'request_id': 'req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:11.530255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7777758be78a46b7b51b52c18d1cdd14', 'request_id': 'req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:11.545427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] The token cache is being invalidate because project 7777758be78a46b7b51b52c18d1cdd14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:11.545814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:11.546393 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:11.548142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1234/2496] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:11 2022] DELETE /identity/v3/projects/7777758be78a46b7b51b52c18d1cdd14 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:20.942484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=62,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:21.541408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:38.329362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:38.330883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:38.398985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c813b-637b-4eb6-959d-92c6299dcc53 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:38.454210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:38.454815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:38.455101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:38.455402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:38.457137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:38.521819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:38.523259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:38.532879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1263/2497] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:43.073536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:43.075162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:43.088880 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7766-63ef-47a7-9c35-d9cda7dfdfc5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:43.093053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed048419-6903-4798-b994-d67359e2a114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:43.093827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed048419-6903-4798-b994-d67359e2a114 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:43.094047 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed048419-6903-4798-b994-d67359e2a114 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:43.094223 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed048419-6903-4798-b994-d67359e2a114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:43.096005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ed048419-6903-4798-b994-d67359e2a114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:43.141777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:43.143714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:43.156936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ccb5e-b679-4fd7-9110-efe18e2a2611 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:43.160754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfd7bf-5919-4a08-8d6a-01d2d9740345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:43.161437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfd7bf-5919-4a08-8d6a-01d2d9740345 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:43.161795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfd7bf-5919-4a08-8d6a-01d2d9740345 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:43.162140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfd7bf-5919-4a08-8d6a-01d2d9740345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:43.163870 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-05cfd7bf-5919-4a08-8d6a-01d2d9740345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:43.171643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed048419-6903-4798-b994-d67359e2a114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:43.173331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed048419-6903-4798-b994-d67359e2a114 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:43.178479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfd7bf-5919-4a08-8d6a-01d2d9740345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:43.180085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfd7bf-5919-4a08-8d6a-01d2d9740345 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:43.185562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1235/2498] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:43.192476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1264/2499] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:59:53.179686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=34 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:53.187115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=76 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:53.947383 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56208-4477-423b-a18a-4cb63b8b99b0 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:53.947676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56208-4477-423b-a18a-4cb63b8b99b0 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:53.947958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56208-4477-423b-a18a-4cb63b8b99b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:53.967052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-24a56208-4477-423b-a18a-4cb63b8b99b0 None None] MFA Rules not processed for user `440c70c023534045b2d6a095db05302d`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:53.968816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-24a56208-4477-423b-a18a-4cb63b8b99b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:54.025210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1236/2500] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 07:59:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:54.406510 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfd7bf-5919-4a08-8d6a-01d2d9740345 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:54.415549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfd7bf-5919-4a08-8d6a-01d2d9740345 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:54.420568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:54.421176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:54.421456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:54.421724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:54.423766 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:54.435450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:54.437747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:54.447674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1265/2501] 10.222.0.17 () {60 vars in 1396 bytes} [Wed Aug 24 07:59:54 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3270 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:04.018337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=25 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:04.443734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=6 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:12.255415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56208-4477-423b-a18a-4cb63b8b99b0 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:12.256837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-24a56208-4477-423b-a18a-4cb63b8b99b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:12.273283 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56208-4477-423b-a18a-4cb63b8b99b0 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:12.278928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91626a-d901-4ff5-aaf3-e0e5e590412d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:12.279570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91626a-d901-4ff5-aaf3-e0e5e590412d service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:12.279853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91626a-d901-4ff5-aaf3-e0e5e590412d service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:12.280134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91626a-d901-4ff5-aaf3-e0e5e590412d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:12.281855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-da91626a-d901-4ff5-aaf3-e0e5e590412d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:12.342683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91626a-d901-4ff5-aaf3-e0e5e590412d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:12.344343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91626a-d901-4ff5-aaf3-e0e5e590412d service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:12.354565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1237/2502] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:18.773479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:18.775529 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:18.792978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1379ba5-40ae-4385-ab09-1d0f37b7f5cb service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:18.799583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc33eb-cdfb-4624-abb6-f70904e4fabb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:18.803033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc33eb-cdfb-4624-abb6-f70904e4fabb service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:18.803033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc33eb-cdfb-4624-abb6-f70904e4fabb service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:18.803033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc33eb-cdfb-4624-abb6-f70904e4fabb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:18.803033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0efc33eb-cdfb-4624-abb6-f70904e4fabb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:18.815799 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc33eb-cdfb-4624-abb6-f70904e4fabb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:18.817379 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc33eb-cdfb-4624-abb6-f70904e4fabb service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:18.829172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1266/2503] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:22.350107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=28 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:23.249940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83d65c-adcb-4a05-aa86-fbbe88b3160e None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:23.250236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83d65c-adcb-4a05-aa86-fbbe88b3160e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:23.250582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83d65c-adcb-4a05-aa86-fbbe88b3160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:23.270542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-0b83d65c-adcb-4a05-aa86-fbbe88b3160e None None] MFA Rules not processed for user `e618ac2e8e884988b42a1d8b195eb457`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:23.271772 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0b83d65c-adcb-4a05-aa86-fbbe88b3160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:23.278689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1238/2504] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:00:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:23.659852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc33eb-cdfb-4624-abb6-f70904e4fabb service nova] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:23.669298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc33eb-cdfb-4624-abb6-f70904e4fabb service nova] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:23.672893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0620f-54fc-4b87-8c81-c67f2b34f6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:23.673557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0620f-54fc-4b87-8c81-c67f2b34f6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:23.673831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0620f-54fc-4b87-8c81-c67f2b34f6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:23.674109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0620f-54fc-4b87-8c81-c67f2b34f6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:23.675914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-11a0620f-54fc-4b87-8c81-c67f2b34f6d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:23.685859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0620f-54fc-4b87-8c81-c67f2b34f6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:23.687620 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0620f-54fc-4b87-8c81-c67f2b34f6d7 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:23.696844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1267/2505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:24.115719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83d65c-adcb-4a05-aa86-fbbe88b3160e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:24.117118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0b83d65c-adcb-4a05-aa86-fbbe88b3160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:24.188618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83d65c-adcb-4a05-aa86-fbbe88b3160e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:24.194455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906e9c-6bd5-44c2-96ff-d925d2720c57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:24.195072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906e9c-6bd5-44c2-96ff-d925d2720c57 service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:24.195385 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906e9c-6bd5-44c2-96ff-d925d2720c57 service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:24.195664 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906e9c-6bd5-44c2-96ff-d925d2720c57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:24.197394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-86906e9c-6bd5-44c2-96ff-d925d2720c57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:24.208804 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86906e9c-6bd5-44c2-96ff-d925d2720c57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:24.210415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86906e9c-6bd5-44c2-96ff-d925d2720c57 service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:24.220387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1239/2506] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:26.743502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0620f-54fc-4b87-8c81-c67f2b34f6d7 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:26.752658 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0620f-54fc-4b87-8c81-c67f2b34f6d7 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:26.756478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5286643-4a04-407f-ac90-c022f1c52c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:26.757065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5286643-4a04-407f-ac90-c022f1c52c17 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:26.757347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5286643-4a04-407f-ac90-c022f1c52c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:26.757622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5286643-4a04-407f-ac90-c022f1c52c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:26.759413 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a5286643-4a04-407f-ac90-c022f1c52c17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:26.769961 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5286643-4a04-407f-ac90-c022f1c52c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:26.771723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5286643-4a04-407f-ac90-c022f1c52c17 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:26.780776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1268/2507] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:33.101436 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906e9c-6bd5-44c2-96ff-d925d2720c57 service placement] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:33.114942 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906e9c-6bd5-44c2-96ff-d925d2720c57 service placement] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:33.120363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:33.120972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:33.121254 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:33.121531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:33.123421 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:33.136990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:33.139087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:33.150199 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1240/2508] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:36.777567 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=18 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:37.452804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5286643-4a04-407f-ac90-c022f1c52c17 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:37.472071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5286643-4a04-407f-ac90-c022f1c52c17 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:37.477643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78636cf-c967-4578-82cf-ed500fb9126c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:37.478327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78636cf-c967-4578-82cf-ed500fb9126c service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:37.478616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78636cf-c967-4578-82cf-ed500fb9126c service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:37.479542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78636cf-c967-4578-82cf-ed500fb9126c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:37.481283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d78636cf-c967-4578-82cf-ed500fb9126c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:37.495176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78636cf-c967-4578-82cf-ed500fb9126c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:37.496960 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78636cf-c967-4578-82cf-ed500fb9126c service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:37.510209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1269/2509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:43.145641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=41 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:47.505472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=6 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:14.344071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:14.347697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:14.413153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb8ff-4a48-4fdc-9ce7-be06dd878435 service nova] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:14.416813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b63fd-609a-45eb-a0ac-79a90569e7e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:14.417428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b63fd-609a-45eb-a0ac-79a90569e7e5 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:14.417710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b63fd-609a-45eb-a0ac-79a90569e7e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:14.417982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b63fd-609a-45eb-a0ac-79a90569e7e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:14.419850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3d5b63fd-609a-45eb-a0ac-79a90569e7e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:14.489366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b63fd-609a-45eb-a0ac-79a90569e7e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:14.491818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b63fd-609a-45eb-a0ac-79a90569e7e5 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:14.501968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1241/2510] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:24.497372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=48 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:25.208964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a5d63-e347-4e4a-8c59-0fc7931498ec None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:25.217520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a5d63-e347-4e4a-8c59-0fc7931498ec None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:25.217520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a5d63-e347-4e4a-8c59-0fc7931498ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:25.229108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-7a9a5d63-e347-4e4a-8c59-0fc7931498ec None None] MFA Rules not processed for user `601dc79382404e90a6acd32d118d13a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:25.230308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7a9a5d63-e347-4e4a-8c59-0fc7931498ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:25.238211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1270/2511] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:01:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:30.366761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b63fd-609a-45eb-a0ac-79a90569e7e5 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:30.375954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b63fd-609a-45eb-a0ac-79a90569e7e5 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:30.379808 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:30.380476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:30.380670 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:30.380938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:30.382727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:30.447684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:30.449138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:30.459359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1242/2512] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:34.637247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a5d63-e347-4e4a-8c59-0fc7931498ec None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:34.638987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7a9a5d63-e347-4e4a-8c59-0fc7931498ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:34.654706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a5d63-e347-4e4a-8c59-0fc7931498ec None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:34.659875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50527e-bed8-4f45-92b1-2ab489c00959 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:34.661336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50527e-bed8-4f45-92b1-2ab489c00959 service placement] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:34.661336 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50527e-bed8-4f45-92b1-2ab489c00959 service placement] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:34.661612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50527e-bed8-4f45-92b1-2ab489c00959 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:34.663462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5a50527e-bed8-4f45-92b1-2ab489c00959 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:34.675065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50527e-bed8-4f45-92b1-2ab489c00959 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:34.676845 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50527e-bed8-4f45-92b1-2ab489c00959 service placement] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:34.687318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1271/2513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:34.758919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:34.761819 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:34.775099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa1c9-a22d-4425-8056-8cec2662fa19 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:34.780001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:34.780737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:34.781147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:34.781427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] PATH_INFO: `/v3/users/440c70c023534045b2d6a095db05302d` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:34.782548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440c70c023534045b2d6a095db05302d)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:34.784544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:34.935921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440c70c023534045b2d6a095db05302d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:34.936582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440c70c023534045b2d6a095db05302d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:34.937431 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440c70c023534045b2d6a095db05302d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:34.949474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440c70c023534045b2d6a095db05302d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:35.012620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ec86557c-c35d-4d03-bc70-39b359bd5de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440c70c023534045b2d6a095db05302d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:35.025418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1243/2514] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:01:34 2022] DELETE /identity/v3/users/440c70c023534045b2d6a095db05302d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:01:35.305405 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50527e-bed8-4f45-92b1-2ab489c00959 service placement] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:35.317840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50527e-bed8-4f45-92b1-2ab489c00959 service placement] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:35.378959 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:35.379578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:35.379855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:35.380127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] PATH_INFO: `/v3/projects/7dcf0c06db934bc285b854f66538f3fb` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:35.381247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dcf0c06db934bc285b854f66538f3fb)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:35.383139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:35.480770 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dcf0c06db934bc285b854f66538f3fb', 'request_id': 'req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:35.486900 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dcf0c06db934bc285b854f66538f3fb', 'request_id': 'req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:35.543495 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dcf0c06db934bc285b854f66538f3fb', 'request_id': 'req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:35.554346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] The token cache is being invalidate because project 7dcf0c06db934bc285b854f66538f3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:01:35.554641 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:35.555259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7056aee0-74c0-4cec-ab3b-cc9d5e106acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:01:35.556790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1272/2515] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:01:35 2022] DELETE /identity/v3/projects/7dcf0c06db934bc285b854f66538f3fb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:01:35.562190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c227b9-d5e9-4ac9-a49a-d0530d615cb7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:35.562482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c227b9-d5e9-4ac9-a49a-d0530d615cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:35.562763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c227b9-d5e9-4ac9-a49a-d0530d615cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:35.584322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c1c227b9-d5e9-4ac9-a49a-d0530d615cb7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:35.585549 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c1c227b9-d5e9-4ac9-a49a-d0530d615cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:35.646295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1244/2516] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:35.654124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272420cb-f1a6-4ca1-a42e-fc9dd9ee7e80 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:35.654565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272420cb-f1a6-4ca1-a42e-fc9dd9ee7e80 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:35.654765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272420cb-f1a6-4ca1-a42e-fc9dd9ee7e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:35.677081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-272420cb-f1a6-4ca1-a42e-fc9dd9ee7e80 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:35.678279 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-272420cb-f1a6-4ca1-a42e-fc9dd9ee7e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:35.686402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1273/2517] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:35.691068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c227b9-d5e9-4ac9-a49a-d0530d615cb7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:35.700850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c227b9-d5e9-4ac9-a49a-d0530d615cb7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:35.705507 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9925-482f-4ee2-978f-beb79cc1b15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:35.706111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9925-482f-4ee2-978f-beb79cc1b15d admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:35.706391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9925-482f-4ee2-978f-beb79cc1b15d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:35.706664 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9925-482f-4ee2-978f-beb79cc1b15d admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:35.707718 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9925-482f-4ee2-978f-beb79cc1b15d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:01:35.708022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9925-482f-4ee2-978f-beb79cc1b15d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:35.709630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9925-482f-4ee2-978f-beb79cc1b15d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:35.711497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:35.723249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1245/2518] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:01:35.728080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272420cb-f1a6-4ca1-a42e-fc9dd9ee7e80 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:35.749275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272420cb-f1a6-4ca1-a42e-fc9dd9ee7e80 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:35.753498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7f945-c667-46df-b2af-79c77eec9a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:35.754314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7f945-c667-46df-b2af-79c77eec9a78 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:35.754603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7f945-c667-46df-b2af-79c77eec9a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:35.754873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7f945-c667-46df-b2af-79c77eec9a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:35.755517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7f945-c667-46df-b2af-79c77eec9a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:35.757449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7f945-c667-46df-b2af-79c77eec9a78 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:35.876887 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1274/2519] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:01:35 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:01:35.881561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9925-482f-4ee2-978f-beb79cc1b15d admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:35.891982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9925-482f-4ee2-978f-beb79cc1b15d admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:35.949360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eafec-ee0d-4b75-85b6-fdcc4ba5cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:35.949892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eafec-ee0d-4b75-85b6-fdcc4ba5cc9f admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:35.950175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eafec-ee0d-4b75-85b6-fdcc4ba5cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:35.950449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eafec-ee0d-4b75-85b6-fdcc4ba5cc9f admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:35.951067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eafec-ee0d-4b75-85b6-fdcc4ba5cc9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:35.953034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eafec-ee0d-4b75-85b6-fdcc4ba5cc9f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:36.035695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1246/2520] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:01:35 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:01:36.039660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7f945-c667-46df-b2af-79c77eec9a78 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:36.050059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7f945-c667-46df-b2af-79c77eec9a78 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:36.055317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4392c1-ea3a-47dc-9c02-511eafcc8de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:36.055951 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4392c1-ea3a-47dc-9c02-511eafcc8de7 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:36.056230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4392c1-ea3a-47dc-9c02-511eafcc8de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:36.056507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4392c1-ea3a-47dc-9c02-511eafcc8de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:36.057138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4392c1-ea3a-47dc-9c02-511eafcc8de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:36.058725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4392c1-ea3a-47dc-9c02-511eafcc8de7 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:36.069521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1275/2521] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:01:36.073465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eafec-ee0d-4b75-85b6-fdcc4ba5cc9f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:36.084025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eafec-ee0d-4b75-85b6-fdcc4ba5cc9f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:36.088725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac857f-81be-4a71-acd3-99c773eebfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:36.089318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac857f-81be-4a71-acd3-99c773eebfba admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:36.089602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac857f-81be-4a71-acd3-99c773eebfba admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:36.089878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac857f-81be-4a71-acd3-99c773eebfba admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:36.090517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac857f-81be-4a71-acd3-99c773eebfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:36.092159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac857f-81be-4a71-acd3-99c773eebfba admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:36.103262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1247/2522] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:01:36.107360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4392c1-ea3a-47dc-9c02-511eafcc8de7 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:36.117392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4392c1-ea3a-47dc-9c02-511eafcc8de7 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:36.122043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd5106-f30a-47d7-ac30-6e82de2cb742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:36.122672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd5106-f30a-47d7-ac30-6e82de2cb742 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:36.122952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd5106-f30a-47d7-ac30-6e82de2cb742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:36.123224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd5106-f30a-47d7-ac30-6e82de2cb742 admin admin] PATH_INFO: `/v3/projects/44615ba18b5a434b860517e87caa741d/users/b9cd8839b2694a6592e1289c6bb8e11f/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:36.137428 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd5106-f30a-47d7-ac30-6e82de2cb742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44615ba18b5a434b860517e87caa741d, user_id=b9cd8839b2694a6592e1289c6bb8e11f, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:36.140098 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd5106-f30a-47d7-ac30-6e82de2cb742 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:36.206461 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1276/2523] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:01:36 2022] PUT /identity/v3/projects/44615ba18b5a434b860517e87caa741d/users/b9cd8839b2694a6592e1289c6bb8e11f/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:01:36.212682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c398f83-ef15-49ef-a110-47e5c6017218 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:36.212951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c398f83-ef15-49ef-a110-47e5c6017218 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:36.213224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c398f83-ef15-49ef-a110-47e5c6017218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:36.232171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-4c398f83-ef15-49ef-a110-47e5c6017218 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:36.239148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4c398f83-ef15-49ef-a110-47e5c6017218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:36.291653 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1248/2524] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:36.302025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd5106-f30a-47d7-ac30-6e82de2cb742 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:36.303777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bdcd5106-f30a-47d7-ac30-6e82de2cb742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:36.313740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:36.362074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd5106-f30a-47d7-ac30-6e82de2cb742 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:36.365942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29e91f-031f-4b98-a282-1d21407580e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:36.366541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29e91f-031f-4b98-a282-1d21407580e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:36.366825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29e91f-031f-4b98-a282-1d21407580e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:36.367096 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29e91f-031f-4b98-a282-1d21407580e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:36.376307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29e91f-031f-4b98-a282-1d21407580e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:36.377738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29e91f-031f-4b98-a282-1d21407580e8 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:36.387473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1277/2525] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:41.714535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5c56-e7cc-4d69-8622-278e34c4d293 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:41.715181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5c56-e7cc-4d69-8622-278e34c4d293 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:41.715181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5c56-e7cc-4d69-8622-278e34c4d293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:41.757907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3f4a5c56-e7cc-4d69-8622-278e34c4d293 None None] MFA Rules not processed for user `b9cd8839b2694a6592e1289c6bb8e11f`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:41.759012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3f4a5c56-e7cc-4d69-8622-278e34c4d293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:41.848194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1249/2526] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:01:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:41.869254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29e91f-031f-4b98-a282-1d21407580e8 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:41.870721 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fa29e91f-031f-4b98-a282-1d21407580e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:41.961713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29e91f-031f-4b98-a282-1d21407580e8 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:41.967374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce926fc-93a6-4b50-a173-3bffde8b72be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:41.968532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce926fc-93a6-4b50-a173-3bffde8b72be service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:41.968532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce926fc-93a6-4b50-a173-3bffde8b72be service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:41.968532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce926fc-93a6-4b50-a173-3bffde8b72be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:41.979727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce926fc-93a6-4b50-a173-3bffde8b72be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:41.981346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce926fc-93a6-4b50-a173-3bffde8b72be service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:41.992532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1278/2527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:45.385675 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92043632-87e9-46b3-ab09-86044e5948c7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:45.386680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92043632-87e9-46b3-ab09-86044e5948c7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:45.387147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92043632-87e9-46b3-ab09-86044e5948c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:45.397520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:45.415666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-92043632-87e9-46b3-ab09-86044e5948c7 None None] MFA Rules not processed for user `b9cd8839b2694a6592e1289c6bb8e11f`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:45.426644 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-92043632-87e9-46b3-ab09-86044e5948c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:45.436508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1250/2528] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:01:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:46.025881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce926fc-93a6-4b50-a173-3bffde8b72be service nova] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:46.027827 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2ce926fc-93a6-4b50-a173-3bffde8b72be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:46.041693 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce926fc-93a6-4b50-a173-3bffde8b72be service nova] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:46.045443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:46.046274 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:46.046557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:46.047065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:46.048932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:46.060275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:46.062233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:46.072185 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1279/2529] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:55.546299 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:56.069236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=63 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:16.141572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7cf78-7619-408e-acbf-343cdbe20d63 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:16.142105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7cf78-7619-408e-acbf-343cdbe20d63 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:16.142205 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7cf78-7619-408e-acbf-343cdbe20d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:16.163141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c9f7cf78-7619-408e-acbf-343cdbe20d63 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:16.164391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c9f7cf78-7619-408e-acbf-343cdbe20d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:16.234858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1251/2530] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 08:02:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:16.274904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:16.276371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:16.346253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a372-bf00-4cb3-8b3a-f5b810c5b085 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:16.352053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f8d42-8b57-4eab-8103-3bf937704d1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:16.352659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8d42-8b57-4eab-8103-3bf937704d1d service swift] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:16.352941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8d42-8b57-4eab-8103-3bf937704d1d service swift] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:16.353216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8d42-8b57-4eab-8103-3bf937704d1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:16.361577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f8d42-8b57-4eab-8103-3bf937704d1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:16.363648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f8d42-8b57-4eab-8103-3bf937704d1d service swift] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:16.371628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1280/2531] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 08:02:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:02:26.228249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=25 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:26.368793 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=32 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:34.163982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c02fd-1040-41f7-b64a-aa53e138e781 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:34.164616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c02fd-1040-41f7-b64a-aa53e138e781 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:34.164802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c02fd-1040-41f7-b64a-aa53e138e781 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:34.167202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1252/2532] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 08:02:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:34.173395 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604facc8-0db5-4ccf-b409-f54db7328836 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:34.174022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604facc8-0db5-4ccf-b409-f54db7328836 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:34.174494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604facc8-0db5-4ccf-b409-f54db7328836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:34.201746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-604facc8-0db5-4ccf-b409-f54db7328836 None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:34.204603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-604facc8-0db5-4ccf-b409-f54db7328836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:34.213708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1281/2533] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 08:02:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:02:34.228316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c02fd-1040-41f7-b64a-aa53e138e781 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:34.231916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f63c02fd-1040-41f7-b64a-aa53e138e781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:34.306034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c02fd-1040-41f7-b64a-aa53e138e781 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:34.310329 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabc794-63a0-45a8-aa8a-afa1a8be9fe2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f436ac7cc2f04919bb0ec1ad9fca5622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:34.311317 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc794-63a0-45a8-aa8a-afa1a8be9fe2 service glance] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:34.311621 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc794-63a0-45a8-aa8a-afa1a8be9fe2 service glance] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:34.311900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabc794-63a0-45a8-aa8a-afa1a8be9fe2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:34.323725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabc794-63a0-45a8-aa8a-afa1a8be9fe2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:34.325108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabc794-63a0-45a8-aa8a-afa1a8be9fe2 service glance] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:34.338179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1253/2534] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:34.555659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c2bb2-c867-4e64-a83d-e7a1676a5171 None None] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:34.555946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c2bb2-c867-4e64-a83d-e7a1676a5171 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:34.556224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c2bb2-c867-4e64-a83d-e7a1676a5171 None None] PATH_INFO: `/` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:34.557565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1282/2535] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 08:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:34.562532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617a20b-5275-4e87-b1e3-b3fc5a38c61c None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:34.562928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617a20b-5275-4e87-b1e3-b3fc5a38c61c None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:34.563101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617a20b-5275-4e87-b1e3-b3fc5a38c61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:34.582829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-9617a20b-5275-4e87-b1e3-b3fc5a38c61c None None] MFA Rules not processed for user `a4403ef0835a4d658f8eb50fac0780eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:34.583968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9617a20b-5275-4e87-b1e3-b3fc5a38c61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:34.590355 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1254/2536] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 08:02:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:34.602098 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c2bb2-c867-4e64-a83d-e7a1676a5171 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:34.613385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c2bb2-c867-4e64-a83d-e7a1676a5171 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:34.617612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa2021-6278-45d1-9e79-dbde8fce252a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:34.618204 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa2021-6278-45d1-9e79-dbde8fce252a service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:34.618492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa2021-6278-45d1-9e79-dbde8fce252a service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:34.618764 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa2021-6278-45d1-9e79-dbde8fce252a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:34.625725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa2021-6278-45d1-9e79-dbde8fce252a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:34.627143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa2021-6278-45d1-9e79-dbde8fce252a service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:34.635829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1283/2537] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:34.719525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4ada-bdbb-4f0b-8e1f-b66f7a156fb7 None None] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:34.719859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4ada-bdbb-4f0b-8e1f-b66f7a156fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:34.720140 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4ada-bdbb-4f0b-8e1f-b66f7a156fb7 None None] PATH_INFO: `/` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:34.721531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1255/2538] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 24 08:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:34.727606 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99501c-ab61-4c2b-9e99-5c20d42d433c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:34.727890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99501c-ab61-4c2b-9e99-5c20d42d433c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:34.728159 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99501c-ab61-4c2b-9e99-5c20d42d433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:34.748025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2a99501c-ab61-4c2b-9e99-5c20d42d433c None None] MFA Rules not processed for user `7d8054e88916456991bf485c19f8b502`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:34.749222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2a99501c-ab61-4c2b-9e99-5c20d42d433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:34.758470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1284/2539] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 24 08:02:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:34.768956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4ada-bdbb-4f0b-8e1f-b66f7a156fb7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:34.780009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4ada-bdbb-4f0b-8e1f-b66f7a156fb7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:34.783548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32024c34-9a67-484e-b66c-75d29aa3ead9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:34.785093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32024c34-9a67-484e-b66c-75d29aa3ead9 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:34.785414 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32024c34-9a67-484e-b66c-75d29aa3ead9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:34.785686 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32024c34-9a67-484e-b66c-75d29aa3ead9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:34.796275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32024c34-9a67-484e-b66c-75d29aa3ead9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:34.797694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32024c34-9a67-484e-b66c-75d29aa3ead9 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:34.809182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1256/2540] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:37.112570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26453b6-bb4b-4f41-b8d8-905ec99f73c8 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:37.113045 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26453b6-bb4b-4f41-b8d8-905ec99f73c8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:37.113151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26453b6-bb4b-4f41-b8d8-905ec99f73c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:37.142100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d26453b6-bb4b-4f41-b8d8-905ec99f73c8 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:37.143280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d26453b6-bb4b-4f41-b8d8-905ec99f73c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:37.163767 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1285/2541] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 08:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:37.175795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32024c34-9a67-484e-b66c-75d29aa3ead9 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:37.220232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32024c34-9a67-484e-b66c-75d29aa3ead9 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:37.225850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54966680-9df6-48f7-a965-fd21738f219d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:37.226446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54966680-9df6-48f7-a965-fd21738f219d service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:37.226726 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54966680-9df6-48f7-a965-fd21738f219d service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:37.227000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54966680-9df6-48f7-a965-fd21738f219d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:37.241498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54966680-9df6-48f7-a965-fd21738f219d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:37.243084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54966680-9df6-48f7-a965-fd21738f219d service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:37.251987 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1257/2542] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 08:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:02:37.709652 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26453b6-bb4b-4f41-b8d8-905ec99f73c8 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:37.728351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26453b6-bb4b-4f41-b8d8-905ec99f73c8 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:37.738314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75338a4f-5ffb-48d4-b50c-9927947ac447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:37.739055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75338a4f-5ffb-48d4-b50c-9927947ac447 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:37.739257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75338a4f-5ffb-48d4-b50c-9927947ac447 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:37.739590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75338a4f-5ffb-48d4-b50c-9927947ac447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:37.741403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-75338a4f-5ffb-48d4-b50c-9927947ac447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:37.853553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75338a4f-5ffb-48d4-b50c-9927947ac447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:37.855346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75338a4f-5ffb-48d4-b50c-9927947ac447 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:37.866782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1286/2543] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:47.248678 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=58 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:47.861237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=56 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:56.374862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54966680-9df6-48f7-a965-fd21738f219d service swift] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:56.376966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-54966680-9df6-48f7-a965-fd21738f219d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:56.490285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54966680-9df6-48f7-a965-fd21738f219d service swift] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:56.496320 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acef95e-49f8-47ea-a2d0-879520b6943a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:56.501562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acef95e-49f8-47ea-a2d0-879520b6943a service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:56.501562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acef95e-49f8-47ea-a2d0-879520b6943a service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:56.501562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acef95e-49f8-47ea-a2d0-879520b6943a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:56.501562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9acef95e-49f8-47ea-a2d0-879520b6943a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:56.512504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acef95e-49f8-47ea-a2d0-879520b6943a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:56.514158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acef95e-49f8-47ea-a2d0-879520b6943a service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:56.524840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1258/2544] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:00.135699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75338a4f-5ffb-48d4-b50c-9927947ac447 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:00.155374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75338a4f-5ffb-48d4-b50c-9927947ac447 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:00.159039 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1302536-520a-4035-8aed-d421beb34e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:00.159668 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1302536-520a-4035-8aed-d421beb34e43 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:00.160054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1302536-520a-4035-8aed-d421beb34e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:00.160310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1302536-520a-4035-8aed-d421beb34e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:00.162066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d1302536-520a-4035-8aed-d421beb34e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:00.197248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1302536-520a-4035-8aed-d421beb34e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:00.198699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1302536-520a-4035-8aed-d421beb34e43 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:00.217948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1287/2545] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:01.459500 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f981-a533-4da4-b8dd-965b2afd9aec None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:01.463008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f981-a533-4da4-b8dd-965b2afd9aec None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:01.463008 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f981-a533-4da4-b8dd-965b2afd9aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:01.491638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-7089f981-a533-4da4-b8dd-965b2afd9aec None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:01.493584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7089f981-a533-4da4-b8dd-965b2afd9aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:01.500895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1259/2546] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 08:03:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:01.519692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1302536-520a-4035-8aed-d421beb34e43 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:01.532618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1302536-520a-4035-8aed-d421beb34e43 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:01.543745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318ffc-9e94-419d-a891-cc09b9ca3dbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:01.543745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318ffc-9e94-419d-a891-cc09b9ca3dbb service swift] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:01.543745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318ffc-9e94-419d-a891-cc09b9ca3dbb service swift] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:01.543745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1318ffc-9e94-419d-a891-cc09b9ca3dbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:01.555914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1318ffc-9e94-419d-a891-cc09b9ca3dbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:01.557621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1318ffc-9e94-419d-a891-cc09b9ca3dbb service swift] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:01.567915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1288/2547] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 08:03:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:03:02.984395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad14bb-6439-4fd1-825b-7f5a2861f164 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:02.984847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad14bb-6439-4fd1-825b-7f5a2861f164 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:02.984949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad14bb-6439-4fd1-825b-7f5a2861f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:03.014132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-50ad14bb-6439-4fd1-825b-7f5a2861f164 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:03.017836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-50ad14bb-6439-4fd1-825b-7f5a2861f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:03.028823 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1260/2548] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 08:03:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:03.043984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318ffc-9e94-419d-a891-cc09b9ca3dbb service swift] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:03.057752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1318ffc-9e94-419d-a891-cc09b9ca3dbb service swift] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:03.063686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9c8ac-f0d0-4d32-a234-fc61d0919398 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:03.064375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9c8ac-f0d0-4d32-a234-fc61d0919398 service swift] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:03.064728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9c8ac-f0d0-4d32-a234-fc61d0919398 service swift] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:03.065072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9c8ac-f0d0-4d32-a234-fc61d0919398 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:03.076541 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9c8ac-f0d0-4d32-a234-fc61d0919398 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:03.078186 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9c8ac-f0d0-4d32-a234-fc61d0919398 service swift] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:03.087952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1289/2549] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 08:03:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:03:09.715542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad14bb-6439-4fd1-825b-7f5a2861f164 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:09.717016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-50ad14bb-6439-4fd1-825b-7f5a2861f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:09.732388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad14bb-6439-4fd1-825b-7f5a2861f164 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:09.737830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:09.738464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.738752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.739030 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] PATH_INFO: `/v3/users/6c2704c142f54c9e8e1058ff8111bb83` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.740580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2704c142f54c9e8e1058ff8111bb83)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:09.743586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:09.889245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2704c142f54c9e8e1058ff8111bb83'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:09.889947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2704c142f54c9e8e1058ff8111bb83'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:09.890561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2704c142f54c9e8e1058ff8111bb83'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:09.902951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2704c142f54c9e8e1058ff8111bb83'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:09.994021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2704c142f54c9e8e1058ff8111bb83'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.009169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1261/2550] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:09 2022] DELETE /identity/v3/users/6c2704c142f54c9e8e1058ff8111bb83 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:10.255243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9c8ac-f0d0-4d32-a234-fc61d0919398 service swift] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:10.267540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9c8ac-f0d0-4d32-a234-fc61d0919398 service swift] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.356544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.357489 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.357937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.358416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] PATH_INFO: `/v3/projects/81c7df6d06aa4fe0bf065921b08afe7f` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.361451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c7df6d06aa4fe0bf065921b08afe7f)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.363202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.461177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c7df6d06aa4fe0bf065921b08afe7f', 'request_id': 'req-cabb0891-2dbe-4165-a140-91e0873782c6'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.467720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c7df6d06aa4fe0bf065921b08afe7f', 'request_id': 'req-cabb0891-2dbe-4165-a140-91e0873782c6'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.513835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c7df6d06aa4fe0bf065921b08afe7f', 'request_id': 'req-cabb0891-2dbe-4165-a140-91e0873782c6'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.529151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] The token cache is being invalidate because project 81c7df6d06aa4fe0bf065921b08afe7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:10.529445 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.531303 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.532933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1290/2551] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:10 2022] DELETE /identity/v3/projects/81c7df6d06aa4fe0bf065921b08afe7f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:10.537050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:10.539210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:10.553169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3626-df7f-406e-b01b-2401312e26d5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.571609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:10.612841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.613481 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.613762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.614038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] PATH_INFO: `/v3/users/75eedd163cb24fb8a05dbbb9efdd6102` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.615179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] RBAC: Authorizing `identity:delete_user(user_id=75eedd163cb24fb8a05dbbb9efdd6102)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.617788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.841838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75eedd163cb24fb8a05dbbb9efdd6102'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.843375 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75eedd163cb24fb8a05dbbb9efdd6102'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.844217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75eedd163cb24fb8a05dbbb9efdd6102'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.860669 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75eedd163cb24fb8a05dbbb9efdd6102'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.913503 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75eedd163cb24fb8a05dbbb9efdd6102'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:10.932378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1262/2552] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:10 2022] DELETE /identity/v3/users/75eedd163cb24fb8a05dbbb9efdd6102 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:11.197240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:11.199562 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:11.219090 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb0891-2dbe-4165-a140-91e0873782c6 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:11.239242 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:11.297924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:11.298629 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:11.298815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:11.299339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] PATH_INFO: `/v3/projects/b6353dd873b942c196c53e11e050fce8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:11.300669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6353dd873b942c196c53e11e050fce8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:11.302737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:11.434501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6353dd873b942c196c53e11e050fce8', 'request_id': 'req-91909146-3f86-466b-90d7-95c63984e15f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.440915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6353dd873b942c196c53e11e050fce8', 'request_id': 'req-91909146-3f86-466b-90d7-95c63984e15f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.519649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6353dd873b942c196c53e11e050fce8', 'request_id': 'req-91909146-3f86-466b-90d7-95c63984e15f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.531086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] The token cache is being invalidate because project b6353dd873b942c196c53e11e050fce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:11.531472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.532067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.533592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1291/2553] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:11 2022] DELETE /identity/v3/projects/b6353dd873b942c196c53e11e050fce8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:12.693050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:12.694678 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.765027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af3422-7a07-4351-948a-fd02e4ef64df admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:12.807047 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:12.831381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:12.833840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.840076 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876db8-48c5-401e-b3ca-c00ff00e0ee8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:12.845875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876db8-48c5-401e-b3ca-c00ff00e0ee8 service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:12.845875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876db8-48c5-401e-b3ca-c00ff00e0ee8 service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:12.845875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876db8-48c5-401e-b3ca-c00ff00e0ee8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:12.845875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c8876db8-48c5-401e-b3ca-c00ff00e0ee8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.862146 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8876db8-48c5-401e-b3ca-c00ff00e0ee8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:12.863935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8876db8-48c5-401e-b3ca-c00ff00e0ee8 service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:12.876333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1263/2554] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:12.928502 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91909146-3f86-466b-90d7-95c63984e15f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:12.934093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:12.934723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:12.934999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:12.935271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] PATH_INFO: `/v3/users/552b00dcd3404a77a929384de9faafec` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:12.936517 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=552b00dcd3404a77a929384de9faafec)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:12.938575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:13.063723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:13.065252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552b00dcd3404a77a929384de9faafec'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.065938 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552b00dcd3404a77a929384de9faafec'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.066576 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552b00dcd3404a77a929384de9faafec'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.182867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552b00dcd3404a77a929384de9faafec'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.196339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552b00dcd3404a77a929384de9faafec'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.208284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1292/2555] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:12 2022] DELETE /identity/v3/users/552b00dcd3404a77a929384de9faafec => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:13.446444 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876db8-48c5-401e-b3ca-c00ff00e0ee8 service placement] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:13.457683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876db8-48c5-401e-b3ca-c00ff00e0ee8 service placement] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:13.518105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:13.518746 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.519029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.519339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] PATH_INFO: `/v3/projects/74a3f469696a4792ba12f2ec03c304b6` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.520473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a3f469696a4792ba12f2ec03c304b6)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:13.522396 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:13.611911 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a3f469696a4792ba12f2ec03c304b6', 'request_id': 'req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.655542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a3f469696a4792ba12f2ec03c304b6', 'request_id': 'req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.661805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a3f469696a4792ba12f2ec03c304b6', 'request_id': 'req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.672935 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] The token cache is being invalidate because project 74a3f469696a4792ba12f2ec03c304b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:13.673225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.673856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.675345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1264/2556] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:13 2022] DELETE /identity/v3/projects/74a3f469696a4792ba12f2ec03c304b6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:13.679408 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:13.680952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:13.694152 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b596eec-d6b5-4a4f-a422-b0f69a62b4b8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:13.749802 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:13.750451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.750753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.751012 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] PATH_INFO: `/v3/users/cc35a5995da348a38d20f9b0529abb9f` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.752172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc35a5995da348a38d20f9b0529abb9f)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:13.754074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:13.892907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc35a5995da348a38d20f9b0529abb9f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.893653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc35a5995da348a38d20f9b0529abb9f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.894218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc35a5995da348a38d20f9b0529abb9f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.936391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc35a5995da348a38d20f9b0529abb9f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.949884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-de4e4105-ddf3-4bec-9419-4ef5eb002ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc35a5995da348a38d20f9b0529abb9f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.962886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1293/2557] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:13 2022] DELETE /identity/v3/users/cc35a5995da348a38d20f9b0529abb9f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:14.235222 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:14.236950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:14.253099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7e1a-0ff7-4f6c-a4ab-d9008b80f699 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:14.311619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:14.312505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:14.312788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:14.313060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] PATH_INFO: `/v3/projects/61a2628b84444d9dadff75840d776013` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:14.314198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a2628b84444d9dadff75840d776013)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:14.316171 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:14.318517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:14.446368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a2628b84444d9dadff75840d776013', 'request_id': 'req-0010c144-708c-4ab5-957e-bcd417666f07'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:14.524841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a2628b84444d9dadff75840d776013', 'request_id': 'req-0010c144-708c-4ab5-957e-bcd417666f07'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:14.532217 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a2628b84444d9dadff75840d776013', 'request_id': 'req-0010c144-708c-4ab5-957e-bcd417666f07'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:14.544917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] The token cache is being invalidate because project 61a2628b84444d9dadff75840d776013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:14.545204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:14.546067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:14.547807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1265/2558] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:14 2022] DELETE /identity/v3/projects/61a2628b84444d9dadff75840d776013 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:23.958626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=66,keystone:INSERT=2,keystone:DELETE=13 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:24.540176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:29.727551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638df30-9788-4147-b241-0ae220db681e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:29.728110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638df30-9788-4147-b241-0ae220db681e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:29.728215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638df30-9788-4147-b241-0ae220db681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:29.747278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8638df30-9788-4147-b241-0ae220db681e None None] MFA Rules not processed for user `601dc79382404e90a6acd32d118d13a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:29.748657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8638df30-9788-4147-b241-0ae220db681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:29.804526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1294/2559] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:03:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:39.797829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=25 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:08.174102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:08.175564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:08.246187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c144-708c-4ab5-957e-bcd417666f07 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:08.250564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5f726-c7e0-4cc4-a021-693068df68a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:08.251166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f726-c7e0-4cc4-a021-693068df68a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:08.251478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f726-c7e0-4cc4-a021-693068df68a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:08.251754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f726-c7e0-4cc4-a021-693068df68a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:08.253467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c2a5f726-c7e0-4cc4-a021-693068df68a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:08.315660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5f726-c7e0-4cc4-a021-693068df68a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:08.317092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5f726-c7e0-4cc4-a021-693068df68a5 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:08.326600 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1266/2560] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:11.894385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638df30-9788-4147-b241-0ae220db681e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:11.897147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8638df30-9788-4147-b241-0ae220db681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:11.911514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638df30-9788-4147-b241-0ae220db681e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:11.916295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:11.917021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:11.917343 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:11.917621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] PATH_INFO: `/v3/users/e618ac2e8e884988b42a1d8b195eb457` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:11.919479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e618ac2e8e884988b42a1d8b195eb457)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:11.921526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:12.131421 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e618ac2e8e884988b42a1d8b195eb457'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.132082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e618ac2e8e884988b42a1d8b195eb457'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.132696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e618ac2e8e884988b42a1d8b195eb457'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.203319 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e618ac2e8e884988b42a1d8b195eb457'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.216586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7300e7f8-7a9a-4d85-b2f3-2baab384308e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e618ac2e8e884988b42a1d8b195eb457'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.228514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1295/2561] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:11 2022] DELETE /identity/v3/users/e618ac2e8e884988b42a1d8b195eb457 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:12.463118 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5f726-c7e0-4cc4-a021-693068df68a5 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:12.475401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5f726-c7e0-4cc4-a021-693068df68a5 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:12.537682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:12.538324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:12.538604 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:12.538875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] PATH_INFO: `/v3/projects/1302fb4e97364c39bf2e177836ffc3c7` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:12.540046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1302fb4e97364c39bf2e177836ffc3c7)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:12.541992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:12.651316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:12.658479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1302fb4e97364c39bf2e177836ffc3c7', 'request_id': 'req-bf757f37-859b-4348-90b3-1fa44877c023'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.701742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1302fb4e97364c39bf2e177836ffc3c7', 'request_id': 'req-bf757f37-859b-4348-90b3-1fa44877c023'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.709126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1302fb4e97364c39bf2e177836ffc3c7', 'request_id': 'req-bf757f37-859b-4348-90b3-1fa44877c023'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.720268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] The token cache is being invalidate because project 1302fb4e97364c39bf2e177836ffc3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:12.720556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.721188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-bf757f37-859b-4348-90b3-1fa44877c023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:12.722669 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1267/2562] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:12 2022] DELETE /identity/v3/projects/1302fb4e97364c39bf2e177836ffc3c7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:12.727722 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e809e3-79c2-4661-ad8b-da2d412fb380 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:12.728134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e809e3-79c2-4661-ad8b-da2d412fb380 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:12.728423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e809e3-79c2-4661-ad8b-da2d412fb380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:12.788880 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-69e809e3-79c2-4661-ad8b-da2d412fb380 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:12.790127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-69e809e3-79c2-4661-ad8b-da2d412fb380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:12.853358 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1296/2563] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:12.861813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e28ed-b8c3-4445-ae80-ad33d3de8947 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:12.862107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e28ed-b8c3-4445-ae80-ad33d3de8947 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:12.862385 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e28ed-b8c3-4445-ae80-ad33d3de8947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:12.882957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3e5e28ed-b8c3-4445-ae80-ad33d3de8947 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:12.884213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3e5e28ed-b8c3-4445-ae80-ad33d3de8947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:12.896528 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1268/2564] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:12.897546 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e809e3-79c2-4661-ad8b-da2d412fb380 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:12.908005 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e809e3-79c2-4661-ad8b-da2d412fb380 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:12.912514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c93b5-5b3e-4e2e-8953-864686131373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:12.913184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c93b5-5b3e-4e2e-8953-864686131373 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:12.913390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c93b5-5b3e-4e2e-8953-864686131373 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:12.913659 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c93b5-5b3e-4e2e-8953-864686131373 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:12.914371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c93b5-5b3e-4e2e-8953-864686131373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:12.914594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c93b5-5b3e-4e2e-8953-864686131373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:12.916318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c93b5-5b3e-4e2e-8953-864686131373 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:12.929424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1297/2565] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:04:12.933661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e28ed-b8c3-4445-ae80-ad33d3de8947 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:12.943898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e28ed-b8c3-4445-ae80-ad33d3de8947 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:12.948590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3201-cedc-42cf-80f3-e31a256d5b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:12.949183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3201-cedc-42cf-80f3-e31a256d5b6a admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:12.949465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3201-cedc-42cf-80f3-e31a256d5b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:12.950252 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3201-cedc-42cf-80f3-e31a256d5b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:12.951497 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a3201-cedc-42cf-80f3-e31a256d5b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:12.953420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a3201-cedc-42cf-80f3-e31a256d5b6a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:13.172017 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1269/2566] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:12 2022] POST /identity/v3/projects => generated 371 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:13.176126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c93b5-5b3e-4e2e-8953-864686131373 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:13.186657 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c93b5-5b3e-4e2e-8953-864686131373 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:13.214499 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:13.245178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b79cfc-9e01-4fd0-a222-905d105f6c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:13.245781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b79cfc-9e01-4fd0-a222-905d105f6c62 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:13.246066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b79cfc-9e01-4fd0-a222-905d105f6c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:13.246342 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b79cfc-9e01-4fd0-a222-905d105f6c62 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:13.247532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b79cfc-9e01-4fd0-a222-905d105f6c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:13.252169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b79cfc-9e01-4fd0-a222-905d105f6c62 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:13.359654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1298/2567] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:13 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:13.364126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3201-cedc-42cf-80f3-e31a256d5b6a admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:13.375841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3201-cedc-42cf-80f3-e31a256d5b6a admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:13.380377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06485e0-9a8b-483d-9419-b15a9d6b1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:13.383133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06485e0-9a8b-483d-9419-b15a9d6b1448 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:13.383133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06485e0-9a8b-483d-9419-b15a9d6b1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:13.383133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06485e0-9a8b-483d-9419-b15a9d6b1448 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:13.383133 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06485e0-9a8b-483d-9419-b15a9d6b1448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:13.383853 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06485e0-9a8b-483d-9419-b15a9d6b1448 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:13.394922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1270/2568] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:13.398852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b79cfc-9e01-4fd0-a222-905d105f6c62 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:13.409074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b79cfc-9e01-4fd0-a222-905d105f6c62 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:13.413713 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3e9a5-e220-4585-a84d-9dd78aaa25fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:13.414306 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3e9a5-e220-4585-a84d-9dd78aaa25fb admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:13.414587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3e9a5-e220-4585-a84d-9dd78aaa25fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:13.414861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3e9a5-e220-4585-a84d-9dd78aaa25fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:13.415526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3e9a5-e220-4585-a84d-9dd78aaa25fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:13.417107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3e9a5-e220-4585-a84d-9dd78aaa25fb admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:13.428431 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1299/2569] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:13.432569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06485e0-9a8b-483d-9419-b15a9d6b1448 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:13.442928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06485e0-9a8b-483d-9419-b15a9d6b1448 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:13.447499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851961ea-7397-4c29-a876-c421d053d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:13.448145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851961ea-7397-4c29-a876-c421d053d65a admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:13.448429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851961ea-7397-4c29-a876-c421d053d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:13.448709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851961ea-7397-4c29-a876-c421d053d65a admin admin] PATH_INFO: `/v3/projects/4e1ebdf8f7294ec0b1041299355a00fe/users/24841364ba8c4bce911f7da40813aa53/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:13.464029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851961ea-7397-4c29-a876-c421d053d65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1ebdf8f7294ec0b1041299355a00fe, user_id=24841364ba8c4bce911f7da40813aa53, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:13.468294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851961ea-7397-4c29-a876-c421d053d65a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:13.546230 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1271/2570] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:13 2022] PUT /identity/v3/projects/4e1ebdf8f7294ec0b1041299355a00fe/users/24841364ba8c4bce911f7da40813aa53/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:13.556649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ed01b-41c4-4735-8745-3b09ceafab6c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:13.556936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ed01b-41c4-4735-8745-3b09ceafab6c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:13.557211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ed01b-41c4-4735-8745-3b09ceafab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:13.585296 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-a99ed01b-41c4-4735-8745-3b09ceafab6c None None] MFA Rules not processed for user `24841364ba8c4bce911f7da40813aa53`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:13.586509 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a99ed01b-41c4-4735-8745-3b09ceafab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:13.651214 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1300/2571] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:13.656384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851961ea-7397-4c29-a876-c421d053d65a admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:13.717737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851961ea-7397-4c29-a876-c421d053d65a admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:13.722256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6b4c4-f86c-4902-b15c-563360f2fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:13.722848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6b4c4-f86c-4902-b15c-563360f2fd89 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:13.723125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6b4c4-f86c-4902-b15c-563360f2fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:13.723428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6b4c4-f86c-4902-b15c-563360f2fd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:13.724035 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6b4c4-f86c-4902-b15c-563360f2fd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:13.725926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6b4c4-f86c-4902-b15c-563360f2fd89 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:13.828748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1272/2572] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:13 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:13.832882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ed01b-41c4-4735-8745-3b09ceafab6c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:13.844415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ed01b-41c4-4735-8745-3b09ceafab6c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:13.900147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca4149-97fb-4ffe-994c-f53b8d079c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:13.900792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca4149-97fb-4ffe-994c-f53b8d079c27 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:13.901050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca4149-97fb-4ffe-994c-f53b8d079c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:13.901347 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca4149-97fb-4ffe-994c-f53b8d079c27 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:13.901979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca4149-97fb-4ffe-994c-f53b8d079c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:13.904083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca4149-97fb-4ffe-994c-f53b8d079c27 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:13.964464 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1301/2573] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:13 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:13.970724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6b4c4-f86c-4902-b15c-563360f2fd89 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:13.980332 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6b4c4-f86c-4902-b15c-563360f2fd89 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:13.985263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22340f5d-db8d-498c-95aa-4c195763d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:13.988095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22340f5d-db8d-498c-95aa-4c195763d2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:13.988095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22340f5d-db8d-498c-95aa-4c195763d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:13.988095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22340f5d-db8d-498c-95aa-4c195763d2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:13.988095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22340f5d-db8d-498c-95aa-4c195763d2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:13.988844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22340f5d-db8d-498c-95aa-4c195763d2b2 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:14.000564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1273/2574] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:14.004864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca4149-97fb-4ffe-994c-f53b8d079c27 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:14.015964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca4149-97fb-4ffe-994c-f53b8d079c27 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:14.020666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75139150-c800-4ce5-9d4f-2571051a8ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:14.022566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75139150-c800-4ce5-9d4f-2571051a8ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:14.022566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75139150-c800-4ce5-9d4f-2571051a8ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:14.022566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75139150-c800-4ce5-9d4f-2571051a8ac3 admin admin] PATH_INFO: `/v3/projects/7a186b7a5d004637bd1922268f455fbc/users/20f4a3d8975f45eb880dc8ca3109a437/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:14.037682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75139150-c800-4ce5-9d4f-2571051a8ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a186b7a5d004637bd1922268f455fbc, user_id=20f4a3d8975f45eb880dc8ca3109a437, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:14.040560 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75139150-c800-4ce5-9d4f-2571051a8ac3 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:14.089201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1302/2575] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:14 2022] PUT /identity/v3/projects/7a186b7a5d004637bd1922268f455fbc/users/20f4a3d8975f45eb880dc8ca3109a437/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:14.094275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22340f5d-db8d-498c-95aa-4c195763d2b2 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:14.104520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22340f5d-db8d-498c-95aa-4c195763d2b2 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:14.143180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:14.161123 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edce49-07ae-4102-a4ee-ed1b32e78468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:14.161731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edce49-07ae-4102-a4ee-ed1b32e78468 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:14.162014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edce49-07ae-4102-a4ee-ed1b32e78468 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:14.162291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edce49-07ae-4102-a4ee-ed1b32e78468 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:14.162934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edce49-07ae-4102-a4ee-ed1b32e78468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:14.164597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edce49-07ae-4102-a4ee-ed1b32e78468 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:14.177434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1274/2576] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:14.180851 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75139150-c800-4ce5-9d4f-2571051a8ac3 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:14.184382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:14.190390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75139150-c800-4ce5-9d4f-2571051a8ac3 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:14.195006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb1e18-14f4-4a27-97b0-55723f257c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:14.195679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1e18-14f4-4a27-97b0-55723f257c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:14.195966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1e18-14f4-4a27-97b0-55723f257c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:14.196237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1e18-14f4-4a27-97b0-55723f257c01 admin admin] PATH_INFO: `/v3/projects/7a186b7a5d004637bd1922268f455fbc/users/20f4a3d8975f45eb880dc8ca3109a437/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:14.198171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb1e18-14f4-4a27-97b0-55723f257c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a186b7a5d004637bd1922268f455fbc, user_id=20f4a3d8975f45eb880dc8ca3109a437, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:14.200871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb1e18-14f4-4a27-97b0-55723f257c01 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:14.211074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1303/2577] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:14 2022] PUT /identity/v3/projects/7a186b7a5d004637bd1922268f455fbc/users/20f4a3d8975f45eb880dc8ca3109a437/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:14.226839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56ad96-82e0-4cf1-8839-5eb1bc3d3e92 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:14.226839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56ad96-82e0-4cf1-8839-5eb1bc3d3e92 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:14.226839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56ad96-82e0-4cf1-8839-5eb1bc3d3e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:14.251795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2e56ad96-82e0-4cf1-8839-5eb1bc3d3e92 None None] MFA Rules not processed for user `20f4a3d8975f45eb880dc8ca3109a437`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:14.253031 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2e56ad96-82e0-4cf1-8839-5eb1bc3d3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:14.323593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1275/2578] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:14.335017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb1e18-14f4-4a27-97b0-55723f257c01 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:14.336757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-efdb1e18-14f4-4a27-97b0-55723f257c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:14.416061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb1e18-14f4-4a27-97b0-55723f257c01 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:14.420293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970e4cb-d555-4d44-8929-72ed1d72fa14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:14.420889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970e4cb-d555-4d44-8929-72ed1d72fa14 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:14.421172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970e4cb-d555-4d44-8929-72ed1d72fa14 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:14.421447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970e4cb-d555-4d44-8929-72ed1d72fa14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:14.430414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970e4cb-d555-4d44-8929-72ed1d72fa14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:14.431890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970e4cb-d555-4d44-8929-72ed1d72fa14 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:14.442231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1304/2579] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:15.318673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56ad96-82e0-4cf1-8839-5eb1bc3d3e92 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:15.382315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56ad96-82e0-4cf1-8839-5eb1bc3d3e92 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:15.386831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:15.387495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:15.388489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:15.388775 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] PATH_INFO: `/v3/users/24841364ba8c4bce911f7da40813aa53` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:15.389904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24841364ba8c4bce911f7da40813aa53)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:15.391871 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:15.564798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24841364ba8c4bce911f7da40813aa53'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:15.565445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24841364ba8c4bce911f7da40813aa53'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:15.566064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24841364ba8c4bce911f7da40813aa53'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:15.577401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:15.578580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24841364ba8c4bce911f7da40813aa53'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:15.654246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24841364ba8c4bce911f7da40813aa53'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:15.666527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1276/2580] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:15 2022] DELETE /identity/v3/users/24841364ba8c4bce911f7da40813aa53 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:15.672192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac4857-eea4-42ca-80f7-1d929e404ce7 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:15.672680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac4857-eea4-42ca-80f7-1d929e404ce7 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:15.672781 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac4857-eea4-42ca-80f7-1d929e404ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:15.692277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f8ac4857-eea4-42ca-80f7-1d929e404ce7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:15.693473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f8ac4857-eea4-42ca-80f7-1d929e404ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:15.751817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1305/2581] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:04:15.761475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:15.762922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:15.819732 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6898-dc17-46d0-a068-55459b210355 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:15.823643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd84e8-d0ac-431f-8d26-39e61d1b5b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:15.824254 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd84e8-d0ac-431f-8d26-39e61d1b5b95 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:15.824535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd84e8-d0ac-431f-8d26-39e61d1b5b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:15.824812 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd84e8-d0ac-431f-8d26-39e61d1b5b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:15.834345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd84e8-d0ac-431f-8d26-39e61d1b5b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:15.835819 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd84e8-d0ac-431f-8d26-39e61d1b5b95 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:15.845649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1277/2582] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:16.234718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac4857-eea4-42ca-80f7-1d929e404ce7 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:16.236208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f8ac4857-eea4-42ca-80f7-1d929e404ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:16.253645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac4857-eea4-42ca-80f7-1d929e404ce7 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:16.258675 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:16.259385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:16.259737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:16.260022 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] PATH_INFO: `/v3/projects/4e1ebdf8f7294ec0b1041299355a00fe` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:16.261173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1ebdf8f7294ec0b1041299355a00fe)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:16.263158 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:16.375918 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1ebdf8f7294ec0b1041299355a00fe', 'request_id': 'req-4110f23e-a919-4e85-916a-e4bc7af01f71'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.382082 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1ebdf8f7294ec0b1041299355a00fe', 'request_id': 'req-4110f23e-a919-4e85-916a-e4bc7af01f71'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.461316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1ebdf8f7294ec0b1041299355a00fe', 'request_id': 'req-4110f23e-a919-4e85-916a-e4bc7af01f71'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.467165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:16.473172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] The token cache is being invalidate because project 4e1ebdf8f7294ec0b1041299355a00fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:16.473473 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.474091 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.475658 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1306/2583] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:16 2022] DELETE /identity/v3/projects/4e1ebdf8f7294ec0b1041299355a00fe => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:16.479786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd84e8-d0ac-431f-8d26-39e61d1b5b95 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:16.489960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd84e8-d0ac-431f-8d26-39e61d1b5b95 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:16.548381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:16.549007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:16.549293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:16.549570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] PATH_INFO: `/v3/users/20f4a3d8975f45eb880dc8ca3109a437` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:16.550696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f4a3d8975f45eb880dc8ca3109a437)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:16.552782 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:16.727040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f4a3d8975f45eb880dc8ca3109a437'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.727720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f4a3d8975f45eb880dc8ca3109a437'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.728336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f4a3d8975f45eb880dc8ca3109a437'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.740544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f4a3d8975f45eb880dc8ca3109a437'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.824330 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7e4e562a-94c8-46fb-81cf-4a820ad9e3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f4a3d8975f45eb880dc8ca3109a437'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:16.834490 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1278/2584] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:16 2022] DELETE /identity/v3/users/20f4a3d8975f45eb880dc8ca3109a437 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:17.273117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:17.274646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:17.288722 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110f23e-a919-4e85-916a-e4bc7af01f71 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:17.347041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:17.347707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:17.347991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:17.348258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] PATH_INFO: `/v3/projects/7a186b7a5d004637bd1922268f455fbc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:17.349360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a186b7a5d004637bd1922268f455fbc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:17.351256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:17.451927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a186b7a5d004637bd1922268f455fbc', 'request_id': 'req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:17.458372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a186b7a5d004637bd1922268f455fbc', 'request_id': 'req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:17.541338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a186b7a5d004637bd1922268f455fbc', 'request_id': 'req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:17.553555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] The token cache is being invalidate because project 7a186b7a5d004637bd1922268f455fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:17.553839 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:17.554459 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e7d314be-8dcb-4202-83ad-e3eedd12d5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:17.556139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1307/2585] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:17 2022] DELETE /identity/v3/projects/7a186b7a5d004637bd1922268f455fbc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:17.561201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd4a6f-62a6-40db-a8eb-3710c40a6539 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:17.561817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd4a6f-62a6-40db-a8eb-3710c40a6539 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:17.561817 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd4a6f-62a6-40db-a8eb-3710c40a6539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:17.569545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:17.581940 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-fcfd4a6f-62a6-40db-a8eb-3710c40a6539 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:17.583203 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-fcfd4a6f-62a6-40db-a8eb-3710c40a6539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:17.642625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1279/2586] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:17.650298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409509f-5574-494a-8658-2105043f4ea1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:17.650584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409509f-5574-494a-8658-2105043f4ea1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:17.650860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409509f-5574-494a-8658-2105043f4ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:17.671311 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-5409509f-5574-494a-8658-2105043f4ea1 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:17.672514 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5409509f-5574-494a-8658-2105043f4ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:17.680331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1308/2587] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:17.685085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd4a6f-62a6-40db-a8eb-3710c40a6539 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:17.695897 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd4a6f-62a6-40db-a8eb-3710c40a6539 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:17.701055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf7c3d-effb-4b2f-bcb7-e44f3fc684a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:17.701730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf7c3d-effb-4b2f-bcb7-e44f3fc684a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:17.702012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf7c3d-effb-4b2f-bcb7-e44f3fc684a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:17.702285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf7c3d-effb-4b2f-bcb7-e44f3fc684a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:17.702930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf7c3d-effb-4b2f-bcb7-e44f3fc684a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:17.703237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf7c3d-effb-4b2f-bcb7-e44f3fc684a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:17.704859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf7c3d-effb-4b2f-bcb7-e44f3fc684a0 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:17.716495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1280/2588] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:17.724882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409509f-5574-494a-8658-2105043f4ea1 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:17.734234 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409509f-5574-494a-8658-2105043f4ea1 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:17.738792 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a337c-df14-4943-a5fd-13afd3a7a3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:17.739414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a337c-df14-4943-a5fd-13afd3a7a3bb admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:17.739694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a337c-df14-4943-a5fd-13afd3a7a3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:17.740018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a337c-df14-4943-a5fd-13afd3a7a3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:17.740630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a337c-df14-4943-a5fd-13afd3a7a3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:17.742503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a337c-df14-4943-a5fd-13afd3a7a3bb admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:17.822623 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1309/2589] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:17 2022] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:17.827408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf7c3d-effb-4b2f-bcb7-e44f3fc684a0 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:17.837326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf7c3d-effb-4b2f-bcb7-e44f3fc684a0 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:17.893733 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8bf9c-1cc5-48fe-955d-612772bf9a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:17.894341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8bf9c-1cc5-48fe-955d-612772bf9a5d admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:17.894623 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8bf9c-1cc5-48fe-955d-612772bf9a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:17.894900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8bf9c-1cc5-48fe-955d-612772bf9a5d admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:17.895564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8bf9c-1cc5-48fe-955d-612772bf9a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:17.897488 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8bf9c-1cc5-48fe-955d-612772bf9a5d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:17.970667 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1281/2590] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:17 2022] POST /identity/v3/users => generated 279 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:17.975061 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a337c-df14-4943-a5fd-13afd3a7a3bb admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:17.986023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a337c-df14-4943-a5fd-13afd3a7a3bb admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:17.990710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f13cd8-840c-40e7-a7a6-971a7279619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:17.991316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f13cd8-840c-40e7-a7a6-971a7279619f admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:17.991644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f13cd8-840c-40e7-a7a6-971a7279619f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:17.991935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f13cd8-840c-40e7-a7a6-971a7279619f admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:17.992551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f13cd8-840c-40e7-a7a6-971a7279619f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:17.994136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f13cd8-840c-40e7-a7a6-971a7279619f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:18.004587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1310/2591] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:18.008508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8bf9c-1cc5-48fe-955d-612772bf9a5d admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:18.018964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8bf9c-1cc5-48fe-955d-612772bf9a5d admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:18.023687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b2a0f-9072-4e79-9d6d-78fc0e31b85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:18.024281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2a0f-9072-4e79-9d6d-78fc0e31b85d admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.024563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2a0f-9072-4e79-9d6d-78fc0e31b85d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.024838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2a0f-9072-4e79-9d6d-78fc0e31b85d admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.025486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b2a0f-9072-4e79-9d6d-78fc0e31b85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:18.027102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b2a0f-9072-4e79-9d6d-78fc0e31b85d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:18.038115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1282/2592] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:18.042259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f13cd8-840c-40e7-a7a6-971a7279619f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:18.052959 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f13cd8-840c-40e7-a7a6-971a7279619f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:18.058007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb021-ad5f-40d8-b62b-5635867a98a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:18.058384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb021-ad5f-40d8-b62b-5635867a98a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.058662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb021-ad5f-40d8-b62b-5635867a98a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.058932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb021-ad5f-40d8-b62b-5635867a98a4 admin admin] PATH_INFO: `/v3/projects/6c59ed4b4d5b4f43baa856d1da9437f7/users/b3afc7ef00104d88a965b0ed3880ae68/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.074734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bb021-ad5f-40d8-b62b-5635867a98a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c59ed4b4d5b4f43baa856d1da9437f7, user_id=b3afc7ef00104d88a965b0ed3880ae68, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:18.077813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bb021-ad5f-40d8-b62b-5635867a98a4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:18.169547 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1311/2593] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:18 2022] PUT /identity/v3/projects/6c59ed4b4d5b4f43baa856d1da9437f7/users/b3afc7ef00104d88a965b0ed3880ae68/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:18.179938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee4163-029b-46da-9230-59dece48ce4e None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.180254 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee4163-029b-46da-9230-59dece48ce4e None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.180554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee4163-029b-46da-9230-59dece48ce4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.209361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d1ee4163-029b-46da-9230-59dece48ce4e None None] MFA Rules not processed for user `b3afc7ef00104d88a965b0ed3880ae68`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:18.210502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d1ee4163-029b-46da-9230-59dece48ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:18.269560 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:18.274873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1283/2594] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:18.279879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb021-ad5f-40d8-b62b-5635867a98a4 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:18.305661 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:18.344042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb021-ad5f-40d8-b62b-5635867a98a4 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:18.349041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d324a5-ddeb-400b-9206-b43c86656bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:18.349645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d324a5-ddeb-400b-9206-b43c86656bbe admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.349928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d324a5-ddeb-400b-9206-b43c86656bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.350201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d324a5-ddeb-400b-9206-b43c86656bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.350822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d324a5-ddeb-400b-9206-b43c86656bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:18.352763 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d324a5-ddeb-400b-9206-b43c86656bbe admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:18.428269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1312/2595] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:18 2022] POST /identity/v3/projects => generated 355 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:18.432381 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee4163-029b-46da-9230-59dece48ce4e None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:18.444909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee4163-029b-46da-9230-59dece48ce4e None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:18.513102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139f36-f15a-467c-899f-0ac452a6b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:18.513723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139f36-f15a-467c-899f-0ac452a6b180 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.513926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139f36-f15a-467c-899f-0ac452a6b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.514200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139f36-f15a-467c-899f-0ac452a6b180 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.514828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139f36-f15a-467c-899f-0ac452a6b180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:18.516810 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139f36-f15a-467c-899f-0ac452a6b180 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:18.593581 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1284/2596] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:18 2022] POST /identity/v3/users => generated 284 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:18.597717 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d324a5-ddeb-400b-9206-b43c86656bbe admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:18.609559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d324a5-ddeb-400b-9206-b43c86656bbe admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:18.614371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b970c-4292-4d3a-bbf6-178e8861df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:18.614975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b970c-4292-4d3a-bbf6-178e8861df16 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.615264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b970c-4292-4d3a-bbf6-178e8861df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.615621 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b970c-4292-4d3a-bbf6-178e8861df16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.616231 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b970c-4292-4d3a-bbf6-178e8861df16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:18.617843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b970c-4292-4d3a-bbf6-178e8861df16 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:18.629174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1313/2597] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:04:18.633351 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139f36-f15a-467c-899f-0ac452a6b180 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:18.644499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139f36-f15a-467c-899f-0ac452a6b180 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:18.649160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160c75b-1f2e-4504-8cd2-c8edf0ea289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:18.649760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160c75b-1f2e-4504-8cd2-c8edf0ea289d admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.650038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160c75b-1f2e-4504-8cd2-c8edf0ea289d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.650307 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160c75b-1f2e-4504-8cd2-c8edf0ea289d admin admin] PATH_INFO: `/v3/projects/ffe1fe756867416198605608c1c9ae7f/users/fed27c8dc6534619b84ada324d2f2038/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.665402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160c75b-1f2e-4504-8cd2-c8edf0ea289d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe1fe756867416198605608c1c9ae7f, user_id=fed27c8dc6534619b84ada324d2f2038, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:18.668073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160c75b-1f2e-4504-8cd2-c8edf0ea289d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:18.740676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1285/2598] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:18 2022] PUT /identity/v3/projects/ffe1fe756867416198605608c1c9ae7f/users/fed27c8dc6534619b84ada324d2f2038/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:18.744795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b970c-4292-4d3a-bbf6-178e8861df16 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:18.755532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b970c-4292-4d3a-bbf6-178e8861df16 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:18.811800 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8542f1-aa1e-4551-8a9b-098d2078f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:18.812671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8542f1-aa1e-4551-8a9b-098d2078f51f admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.812955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8542f1-aa1e-4551-8a9b-098d2078f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.813232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8542f1-aa1e-4551-8a9b-098d2078f51f admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.813932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8542f1-aa1e-4551-8a9b-098d2078f51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:18.815543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8542f1-aa1e-4551-8a9b-098d2078f51f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:18.826354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1314/2599] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:18.832818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160c75b-1f2e-4504-8cd2-c8edf0ea289d admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:18.844213 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160c75b-1f2e-4504-8cd2-c8edf0ea289d admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:18.848995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f5748-180e-4977-9872-5030ce09645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:18.849584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f5748-180e-4977-9872-5030ce09645e admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.849866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f5748-180e-4977-9872-5030ce09645e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.850169 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f5748-180e-4977-9872-5030ce09645e admin admin] PATH_INFO: `/v3/projects/ffe1fe756867416198605608c1c9ae7f/users/fed27c8dc6534619b84ada324d2f2038/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.852104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f5748-180e-4977-9872-5030ce09645e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe1fe756867416198605608c1c9ae7f, user_id=fed27c8dc6534619b84ada324d2f2038, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:18.854849 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f5748-180e-4977-9872-5030ce09645e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:18.866021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1286/2600] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:18 2022] PUT /identity/v3/projects/ffe1fe756867416198605608c1c9ae7f/users/fed27c8dc6534619b84ada324d2f2038/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:18.878636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f95f-b090-45e8-9e20-9f32d1f84ad1 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:18.878927 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f95f-b090-45e8-9e20-9f32d1f84ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:18.879267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f95f-b090-45e8-9e20-9f32d1f84ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:18.907639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-a2d1f95f-b090-45e8-9e20-9f32d1f84ad1 None None] MFA Rules not processed for user `fed27c8dc6534619b84ada324d2f2038`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:18.909825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a2d1f95f-b090-45e8-9e20-9f32d1f84ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:18.977314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1315/2601] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:18.989244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f5748-180e-4977-9872-5030ce09645e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:18.990914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ea5f5748-180e-4977-9872-5030ce09645e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:19.049909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f5748-180e-4977-9872-5030ce09645e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:19.053548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef261f3-4aa2-4757-a824-f714cac518fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:19.054149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef261f3-4aa2-4757-a824-f714cac518fc service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:19.054432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef261f3-4aa2-4757-a824-f714cac518fc service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:19.054705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef261f3-4aa2-4757-a824-f714cac518fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:19.064057 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef261f3-4aa2-4757-a824-f714cac518fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:19.065492 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef261f3-4aa2-4757-a824-f714cac518fc service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:19.074917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1287/2602] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:19.297293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1f95f-b090-45e8-9e20-9f32d1f84ad1 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:19.306998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1f95f-b090-45e8-9e20-9f32d1f84ad1 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:19.310481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e358-449b-45b3-af74-3b886206a147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:19.311569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e358-449b-45b3-af74-3b886206a147 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:19.311862 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e358-449b-45b3-af74-3b886206a147 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:19.312388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e358-449b-45b3-af74-3b886206a147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:19.324996 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:19.374479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e358-449b-45b3-af74-3b886206a147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:19.376437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e358-449b-45b3-af74-3b886206a147 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:19.385331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1316/2603] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:29.070650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:29.403978 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=20 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:36.757212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef261f3-4aa2-4757-a824-f714cac518fc service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:36.833830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef261f3-4aa2-4757-a824-f714cac518fc service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:36.838353 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:36.838983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:36.839265 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:36.839573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] PATH_INFO: `/v3/users/b3afc7ef00104d88a965b0ed3880ae68` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:36.840694 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3afc7ef00104d88a965b0ed3880ae68)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:36.842617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:37.023750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3afc7ef00104d88a965b0ed3880ae68'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.024333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3afc7ef00104d88a965b0ed3880ae68'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.024939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3afc7ef00104d88a965b0ed3880ae68'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.036960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3afc7ef00104d88a965b0ed3880ae68'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.106064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3afc7ef00104d88a965b0ed3880ae68'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.118557 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1288/2604] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:36 2022] DELETE /identity/v3/users/b3afc7ef00104d88a965b0ed3880ae68 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:37.123041 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25624c-8b9a-46cc-8d98-1eede54b4fdf None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:37.126950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25624c-8b9a-46cc-8d98-1eede54b4fdf None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:37.126950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25624c-8b9a-46cc-8d98-1eede54b4fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:37.143804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2f25624c-8b9a-46cc-8d98-1eede54b4fdf None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:37.144997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2f25624c-8b9a-46cc-8d98-1eede54b4fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:37.208145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1317/2605] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:04:37.217985 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:37.219595 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:37.277983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b408cf-5f74-4857-b9e5-1ac8a3838a89 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:37.281803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1ba78-7f48-4560-8e00-9e7731be7592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:37.282401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1ba78-7f48-4560-8e00-9e7731be7592 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:37.282684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1ba78-7f48-4560-8e00-9e7731be7592 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:37.282961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1ba78-7f48-4560-8e00-9e7731be7592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:37.292012 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1ba78-7f48-4560-8e00-9e7731be7592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:37.293451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1ba78-7f48-4560-8e00-9e7731be7592 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:37.303105 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1289/2606] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:37.712565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25624c-8b9a-46cc-8d98-1eede54b4fdf None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:37.713990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2f25624c-8b9a-46cc-8d98-1eede54b4fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:37.727753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25624c-8b9a-46cc-8d98-1eede54b4fdf None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:37.732398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:37.733071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:37.733350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:37.734398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] PATH_INFO: `/v3/projects/6c59ed4b4d5b4f43baa856d1da9437f7` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:37.735746 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c59ed4b4d5b4f43baa856d1da9437f7)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:37.737753 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:37.841782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c59ed4b4d5b4f43baa856d1da9437f7', 'request_id': 'req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.851757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c59ed4b4d5b4f43baa856d1da9437f7', 'request_id': 'req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.917941 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c59ed4b4d5b4f43baa856d1da9437f7', 'request_id': 'req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.929233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] The token cache is being invalidate because project 6c59ed4b4d5b4f43baa856d1da9437f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:37.929516 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.930148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:37.931676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1318/2607] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:37 2022] DELETE /identity/v3/projects/6c59ed4b4d5b4f43baa856d1da9437f7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:37.935705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1ba78-7f48-4560-8e00-9e7731be7592 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:37.946358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1ba78-7f48-4560-8e00-9e7731be7592 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:37.965007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:38.002807 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:38.003464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:38.003747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:38.004020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] PATH_INFO: `/v3/users/fed27c8dc6534619b84ada324d2f2038` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:38.005134 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed27c8dc6534619b84ada324d2f2038)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:38.007055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:38.159976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed27c8dc6534619b84ada324d2f2038'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.160553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed27c8dc6534619b84ada324d2f2038'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.161159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed27c8dc6534619b84ada324d2f2038'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.173441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed27c8dc6534619b84ada324d2f2038'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.255376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f2f605ff-e3cf-4f93-aca0-ca684fc4d0d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed27c8dc6534619b84ada324d2f2038'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.268166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1290/2608] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:37 2022] DELETE /identity/v3/users/fed27c8dc6534619b84ada324d2f2038 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:38.667006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:38.668545 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:38.682465 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a6806-62dc-407e-b7cb-cf1cff2703b9 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:38.739603 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:38.740232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:38.740524 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:38.740801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] PATH_INFO: `/v3/projects/ffe1fe756867416198605608c1c9ae7f` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:38.741913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe1fe756867416198605608c1c9ae7f)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:38.743863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:38.833625 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:38.850379 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe1fe756867416198605608c1c9ae7f', 'request_id': 'req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.856497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe1fe756867416198605608c1c9ae7f', 'request_id': 'req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.951222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe1fe756867416198605608c1c9ae7f', 'request_id': 'req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.962483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] The token cache is being invalidate because project ffe1fe756867416198605608c1c9ae7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:38.962754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.963409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-0f35ba72-f09c-4d04-9d2d-4105a9c7754b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:38.964884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1319/2609] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:38 2022] DELETE /identity/v3/projects/ffe1fe756867416198605608c1c9ae7f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:38.970387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401438-5996-4b27-9b52-3aa0fba6408a None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:38.970919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401438-5996-4b27-9b52-3aa0fba6408a None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:38.970919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401438-5996-4b27-9b52-3aa0fba6408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:38.990210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2f401438-5996-4b27-9b52-3aa0fba6408a None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:38.991453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2f401438-5996-4b27-9b52-3aa0fba6408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:39.051359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1291/2610] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:39.058984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2a2fe-c9cd-4ce3-a68e-6e1188e71d29 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.059278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2a2fe-c9cd-4ce3-a68e-6e1188e71d29 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.059584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2a2fe-c9cd-4ce3-a68e-6e1188e71d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.079965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-dbf2a2fe-c9cd-4ce3-a68e-6e1188e71d29 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:39.081179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-dbf2a2fe-c9cd-4ce3-a68e-6e1188e71d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:39.089060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1320/2611] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:39.093467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401438-5996-4b27-9b52-3aa0fba6408a None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.103194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401438-5996-4b27-9b52-3aa0fba6408a None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.107747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded704c1-47f4-4c81-8ca2-45a950e2d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.108337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded704c1-47f4-4c81-8ca2-45a950e2d027 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.108616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded704c1-47f4-4c81-8ca2-45a950e2d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.108885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded704c1-47f4-4c81-8ca2-45a950e2d027 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.110322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded704c1-47f4-4c81-8ca2-45a950e2d027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:39.110635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded704c1-47f4-4c81-8ca2-45a950e2d027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.112255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded704c1-47f4-4c81-8ca2-45a950e2d027 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.123864 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1292/2612] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:39.128830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2a2fe-c9cd-4ce3-a68e-6e1188e71d29 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.138088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2a2fe-c9cd-4ce3-a68e-6e1188e71d29 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.143481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac77b86-9f32-4c9c-b650-f6954a0a938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.144073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac77b86-9f32-4c9c-b650-f6954a0a938b admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.144362 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac77b86-9f32-4c9c-b650-f6954a0a938b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.144639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac77b86-9f32-4c9c-b650-f6954a0a938b admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.145263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac77b86-9f32-4c9c-b650-f6954a0a938b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.147200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac77b86-9f32-4c9c-b650-f6954a0a938b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.261961 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1321/2613] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:39 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:39.266885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded704c1-47f4-4c81-8ca2-45a950e2d027 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.276954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded704c1-47f4-4c81-8ca2-45a950e2d027 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.304517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:39.334865 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6286a4-8732-4fcb-9bfc-4d2c4fc11ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.335502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6286a4-8732-4fcb-9bfc-4d2c4fc11ded admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.335797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6286a4-8732-4fcb-9bfc-4d2c4fc11ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.336083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6286a4-8732-4fcb-9bfc-4d2c4fc11ded admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.336709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6286a4-8732-4fcb-9bfc-4d2c4fc11ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.338815 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6286a4-8732-4fcb-9bfc-4d2c4fc11ded admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.429179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1293/2614] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:39 2022] POST /identity/v3/users => generated 284 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:39.433355 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac77b86-9f32-4c9c-b650-f6954a0a938b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.444201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac77b86-9f32-4c9c-b650-f6954a0a938b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.448870 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676646b-b20d-49d9-a844-a5ea9e382c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.449455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676646b-b20d-49d9-a844-a5ea9e382c65 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.449731 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676646b-b20d-49d9-a844-a5ea9e382c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.449998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676646b-b20d-49d9-a844-a5ea9e382c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.450626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676646b-b20d-49d9-a844-a5ea9e382c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.452263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676646b-b20d-49d9-a844-a5ea9e382c65 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.462083 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1322/2615] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:39.465955 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6286a4-8732-4fcb-9bfc-4d2c4fc11ded admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.476333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6286a4-8732-4fcb-9bfc-4d2c4fc11ded admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.480969 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb532d-8dba-4890-a7bd-9baaed5fda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.481563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb532d-8dba-4890-a7bd-9baaed5fda10 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.481841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb532d-8dba-4890-a7bd-9baaed5fda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.482112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb532d-8dba-4890-a7bd-9baaed5fda10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.482743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb532d-8dba-4890-a7bd-9baaed5fda10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.485002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb532d-8dba-4890-a7bd-9baaed5fda10 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.496502 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1294/2616] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:39.500886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676646b-b20d-49d9-a844-a5ea9e382c65 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.510843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676646b-b20d-49d9-a844-a5ea9e382c65 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.515594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6990c-296a-4c9e-b3a6-96d4408d1511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.516176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6990c-296a-4c9e-b3a6-96d4408d1511 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.516458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6990c-296a-4c9e-b3a6-96d4408d1511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.516733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6990c-296a-4c9e-b3a6-96d4408d1511 admin admin] PATH_INFO: `/v3/projects/5f7a5983bcb44ee29e732554afdef889/users/9c9220b6eed94c28adf5876a13a7d3de/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.531633 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6990c-296a-4c9e-b3a6-96d4408d1511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7a5983bcb44ee29e732554afdef889, user_id=9c9220b6eed94c28adf5876a13a7d3de, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.534377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6990c-296a-4c9e-b3a6-96d4408d1511 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.607824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1323/2617] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:39 2022] PUT /identity/v3/projects/5f7a5983bcb44ee29e732554afdef889/users/9c9220b6eed94c28adf5876a13a7d3de/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:39.619182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561893e-06fb-4305-ba29-37d38cba5419 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.619525 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561893e-06fb-4305-ba29-37d38cba5419 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.633546 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561893e-06fb-4305-ba29-37d38cba5419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.647489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3561893e-06fb-4305-ba29-37d38cba5419 None None] MFA Rules not processed for user `9c9220b6eed94c28adf5876a13a7d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:39.648722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3561893e-06fb-4305-ba29-37d38cba5419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:39.711179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1295/2618] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:39.715631 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6990c-296a-4c9e-b3a6-96d4408d1511 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.776364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6990c-296a-4c9e-b3a6-96d4408d1511 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.781278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8b410-1780-49a9-a3f5-8278b06bee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.781888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8b410-1780-49a9-a3f5-8278b06bee8a admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.782170 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8b410-1780-49a9-a3f5-8278b06bee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.782449 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8b410-1780-49a9-a3f5-8278b06bee8a admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.783081 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8b410-1780-49a9-a3f5-8278b06bee8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.785019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8b410-1780-49a9-a3f5-8278b06bee8a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:39.896084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1324/2619] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:39 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:39.900128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561893e-06fb-4305-ba29-37d38cba5419 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:39.911340 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561893e-06fb-4305-ba29-37d38cba5419 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:39.967539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7add2-e566-4821-b285-cceb11869896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:39.968147 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7add2-e566-4821-b285-cceb11869896 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:39.968923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7add2-e566-4821-b285-cceb11869896 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:39.969198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7add2-e566-4821-b285-cceb11869896 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:39.969826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7add2-e566-4821-b285-cceb11869896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:39.971795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7add2-e566-4821-b285-cceb11869896 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.050556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1296/2620] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:39 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:40.054605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8b410-1780-49a9-a3f5-8278b06bee8a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:40.065440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8b410-1780-49a9-a3f5-8278b06bee8a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:40.070246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecb8d0-991c-4ba9-9cdf-dd3bde3961c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:40.070913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecb8d0-991c-4ba9-9cdf-dd3bde3961c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.071195 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecb8d0-991c-4ba9-9cdf-dd3bde3961c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.071497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecb8d0-991c-4ba9-9cdf-dd3bde3961c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.078549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecb8d0-991c-4ba9-9cdf-dd3bde3961c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:40.078549 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecb8d0-991c-4ba9-9cdf-dd3bde3961c2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.084444 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1325/2621] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:40.088583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7add2-e566-4821-b285-cceb11869896 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:40.099677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7add2-e566-4821-b285-cceb11869896 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:40.104343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fea55e-25b2-401a-8274-acce3eee788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:40.104977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fea55e-25b2-401a-8274-acce3eee788b admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.105255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fea55e-25b2-401a-8274-acce3eee788b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.105526 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fea55e-25b2-401a-8274-acce3eee788b admin admin] PATH_INFO: `/v3/projects/22fe0f00cdf04f21ad1170063b7fe70e/users/7599c085e0624d7a9b799426b9e6adb7/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.120912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fea55e-25b2-401a-8274-acce3eee788b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fe0f00cdf04f21ad1170063b7fe70e, user_id=7599c085e0624d7a9b799426b9e6adb7, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:40.123603 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fea55e-25b2-401a-8274-acce3eee788b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.192627 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1297/2622] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:40 2022] PUT /identity/v3/projects/22fe0f00cdf04f21ad1170063b7fe70e/users/7599c085e0624d7a9b799426b9e6adb7/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:40.202291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecb8d0-991c-4ba9-9cdf-dd3bde3961c2 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:40.212716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecb8d0-991c-4ba9-9cdf-dd3bde3961c2 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:40.225526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:40.270804 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b79019-f8c0-4718-8185-93f21202d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:40.271481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79019-f8c0-4718-8185-93f21202d29d admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.271777 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79019-f8c0-4718-8185-93f21202d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.272058 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b79019-f8c0-4718-8185-93f21202d29d admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.272699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b79019-f8c0-4718-8185-93f21202d29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:40.274289 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b79019-f8c0-4718-8185-93f21202d29d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.285257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1326/2623] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:04:40.289392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fea55e-25b2-401a-8274-acce3eee788b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:40.294843 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:40.301423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fea55e-25b2-401a-8274-acce3eee788b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:40.306139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78330569-118c-499e-ad6f-7bd7915f7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:40.306784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330569-118c-499e-ad6f-7bd7915f7cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.307066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330569-118c-499e-ad6f-7bd7915f7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.307432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78330569-118c-499e-ad6f-7bd7915f7cf1 admin admin] PATH_INFO: `/v3/projects/22fe0f00cdf04f21ad1170063b7fe70e/users/7599c085e0624d7a9b799426b9e6adb7/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.309362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78330569-118c-499e-ad6f-7bd7915f7cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fe0f00cdf04f21ad1170063b7fe70e, user_id=7599c085e0624d7a9b799426b9e6adb7, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:40.312699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78330569-118c-499e-ad6f-7bd7915f7cf1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.322967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1298/2624] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:40 2022] PUT /identity/v3/projects/22fe0f00cdf04f21ad1170063b7fe70e/users/7599c085e0624d7a9b799426b9e6adb7/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:40.333895 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441e5d9-6fbe-4725-858d-e68aaeb6f1eb None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.334218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441e5d9-6fbe-4725-858d-e68aaeb6f1eb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.334498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441e5d9-6fbe-4725-858d-e68aaeb6f1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.364722 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1441e5d9-6fbe-4725-858d-e68aaeb6f1eb None None] MFA Rules not processed for user `7599c085e0624d7a9b799426b9e6adb7`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:40.365950 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1441e5d9-6fbe-4725-858d-e68aaeb6f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:40.434774 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1327/2625] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:40.446868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78330569-118c-499e-ad6f-7bd7915f7cf1 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:40.448593 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-78330569-118c-499e-ad6f-7bd7915f7cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:40.506032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78330569-118c-499e-ad6f-7bd7915f7cf1 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:40.509646 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0e780-ba71-42c8-87d9-cf23bb157802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:40.510237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0e780-ba71-42c8-87d9-cf23bb157802 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.510518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0e780-ba71-42c8-87d9-cf23bb157802 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.510788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0e780-ba71-42c8-87d9-cf23bb157802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.520292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0e780-ba71-42c8-87d9-cf23bb157802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:40.521710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0e780-ba71-42c8-87d9-cf23bb157802 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.530968 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1299/2626] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:40.623573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441e5d9-6fbe-4725-858d-e68aaeb6f1eb None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:40.625249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1441e5d9-6fbe-4725-858d-e68aaeb6f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:40.637373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441e5d9-6fbe-4725-858d-e68aaeb6f1eb None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:40.641706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8afa4-6cfe-4890-a823-82f007f6217f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:40.642383 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8afa4-6cfe-4890-a823-82f007f6217f service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:40.642661 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8afa4-6cfe-4890-a823-82f007f6217f service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:40.642935 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8afa4-6cfe-4890-a823-82f007f6217f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:40.699647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8afa4-6cfe-4890-a823-82f007f6217f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:40.701085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8afa4-6cfe-4890-a823-82f007f6217f service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:40.710582 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1328/2627] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:45.347083 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0e780-ba71-42c8-87d9-cf23bb157802 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:45.409957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0e780-ba71-42c8-87d9-cf23bb157802 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:45.414350 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:45.414966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:45.415243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:45.415541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] PATH_INFO: `/v3/users/9c9220b6eed94c28adf5876a13a7d3de` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:45.416668 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9220b6eed94c28adf5876a13a7d3de)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:45.418567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:45.623722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9220b6eed94c28adf5876a13a7d3de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:45.624451 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9220b6eed94c28adf5876a13a7d3de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:45.625856 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9220b6eed94c28adf5876a13a7d3de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:45.638072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9220b6eed94c28adf5876a13a7d3de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:45.706328 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9220b6eed94c28adf5876a13a7d3de'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:45.718956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1300/2628] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:45 2022] DELETE /identity/v3/users/9c9220b6eed94c28adf5876a13a7d3de => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:45.723486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc401e-ea52-4a8c-b7d0-b7368e453bb4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:45.723983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc401e-ea52-4a8c-b7d0-b7368e453bb4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:45.724109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc401e-ea52-4a8c-b7d0-b7368e453bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:45.745984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-fdfc401e-ea52-4a8c-b7d0-b7368e453bb4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:45.747172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fdfc401e-ea52-4a8c-b7d0-b7368e453bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:45.778512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:45.807932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1329/2629] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:45.818406 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:45.819885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:45.833277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:45.880376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713d1a-3b14-4dc3-a5d9-c93b23d119f1 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:45.884753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f6526-a111-4565-8707-3fc2713e0fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:45.885417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f6526-a111-4565-8707-3fc2713e0fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:45.885701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f6526-a111-4565-8707-3fc2713e0fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:45.885977 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f6526-a111-4565-8707-3fc2713e0fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:45.895437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f6526-a111-4565-8707-3fc2713e0fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:45.896896 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f6526-a111-4565-8707-3fc2713e0fc5 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:45.907338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1301/2630] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:46.331447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc401e-ea52-4a8c-b7d0-b7368e453bb4 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.333140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fdfc401e-ea52-4a8c-b7d0-b7368e453bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.347649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc401e-ea52-4a8c-b7d0-b7368e453bb4 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.353020 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.353672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.354052 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.354392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] PATH_INFO: `/v3/projects/5f7a5983bcb44ee29e732554afdef889` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.355667 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7a5983bcb44ee29e732554afdef889)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.357881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.462073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7a5983bcb44ee29e732554afdef889', 'request_id': 'req-81bd20c2-646a-46f9-ad93-b66d6138224d'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.469001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7a5983bcb44ee29e732554afdef889', 'request_id': 'req-81bd20c2-646a-46f9-ad93-b66d6138224d'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.535352 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7a5983bcb44ee29e732554afdef889', 'request_id': 'req-81bd20c2-646a-46f9-ad93-b66d6138224d'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.546730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] The token cache is being invalidate because project 5f7a5983bcb44ee29e732554afdef889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:46.547024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.548432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.551540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1330/2631] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:46 2022] DELETE /identity/v3/projects/5f7a5983bcb44ee29e732554afdef889 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:46.554111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f6526-a111-4565-8707-3fc2713e0fc5 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.564882 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f6526-a111-4565-8707-3fc2713e0fc5 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.624557 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.625296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.625563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.625870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] PATH_INFO: `/v3/users/7599c085e0624d7a9b799426b9e6adb7` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.626958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7599c085e0624d7a9b799426b9e6adb7)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.629584 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.784018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7599c085e0624d7a9b799426b9e6adb7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.785765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7599c085e0624d7a9b799426b9e6adb7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.785765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7599c085e0624d7a9b799426b9e6adb7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.799054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7599c085e0624d7a9b799426b9e6adb7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.882289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-be82bebf-563c-4323-8dc9-7f0a61d27738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7599c085e0624d7a9b799426b9e6adb7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.895141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1302/2632] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:46 2022] DELETE /identity/v3/users/7599c085e0624d7a9b799426b9e6adb7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:47.330803 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.335073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.346745 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd20c2-646a-46f9-ad93-b66d6138224d admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.412507 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.413164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.413446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.413723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] PATH_INFO: `/v3/projects/22fe0f00cdf04f21ad1170063b7fe70e` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.414831 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fe0f00cdf04f21ad1170063b7fe70e)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.416765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.554200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fe0f00cdf04f21ad1170063b7fe70e', 'request_id': 'req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.560410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fe0f00cdf04f21ad1170063b7fe70e', 'request_id': 'req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.649019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fe0f00cdf04f21ad1170063b7fe70e', 'request_id': 'req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.650320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:47.660969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] The token cache is being invalidate because project 22fe0f00cdf04f21ad1170063b7fe70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:47.661249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.661870 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-3dc44cd6-9adb-40ed-97b4-4932fe1d6dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.663373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1331/2633] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:47 2022] DELETE /identity/v3/projects/22fe0f00cdf04f21ad1170063b7fe70e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:47.668281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fbfc3-36c8-4940-a0b2-eba7925b36ec None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.668781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fbfc3-36c8-4940-a0b2-eba7925b36ec None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.668892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fbfc3-36c8-4940-a0b2-eba7925b36ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.690291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ab2fbfc3-36c8-4940-a0b2-eba7925b36ec None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.691548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ab2fbfc3-36c8-4940-a0b2-eba7925b36ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.721431 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:47.752201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1303/2634] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:47.760931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7905088-4e2e-44a7-919e-037af25b0fb8 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.761224 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7905088-4e2e-44a7-919e-037af25b0fb8 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.761499 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7905088-4e2e-44a7-919e-037af25b0fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.781114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f7905088-4e2e-44a7-919e-037af25b0fb8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.782305 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f7905088-4e2e-44a7-919e-037af25b0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.790382 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1332/2635] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:47.794298 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fbfc3-36c8-4940-a0b2-eba7925b36ec None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.804658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fbfc3-36c8-4940-a0b2-eba7925b36ec None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.809378 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1076a48-9400-4b3f-8e23-c883fd5e6a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.809972 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1076a48-9400-4b3f-8e23-c883fd5e6a95 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.810256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1076a48-9400-4b3f-8e23-c883fd5e6a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.810533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1076a48-9400-4b3f-8e23-c883fd5e6a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.811180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1076a48-9400-4b3f-8e23-c883fd5e6a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:47.811516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1076a48-9400-4b3f-8e23-c883fd5e6a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.813665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1076a48-9400-4b3f-8e23-c883fd5e6a95 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.825541 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1304/2636] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:47.830375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7905088-4e2e-44a7-919e-037af25b0fb8 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.839494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7905088-4e2e-44a7-919e-037af25b0fb8 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.844237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44b12-0c91-4eee-a378-57a2f8a36c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.844825 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44b12-0c91-4eee-a378-57a2f8a36c26 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.845103 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44b12-0c91-4eee-a378-57a2f8a36c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.845375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44b12-0c91-4eee-a378-57a2f8a36c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.846001 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a44b12-0c91-4eee-a378-57a2f8a36c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.847952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a44b12-0c91-4eee-a378-57a2f8a36c26 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.936284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1333/2637] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:47.940910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1076a48-9400-4b3f-8e23-c883fd5e6a95 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.950873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1076a48-9400-4b3f-8e23-c883fd5e6a95 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.006430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9991a9b-d85d-4eb8-b442-4af6d69374e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.007040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991a9b-d85d-4eb8-b442-4af6d69374e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.007419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991a9b-d85d-4eb8-b442-4af6d69374e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.007701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9991a9b-d85d-4eb8-b442-4af6d69374e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.008336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9991a9b-d85d-4eb8-b442-4af6d69374e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.010261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9991a9b-d85d-4eb8-b442-4af6d69374e7 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.101499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1305/2638] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:48.105172 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44b12-0c91-4eee-a378-57a2f8a36c26 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.116423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44b12-0c91-4eee-a378-57a2f8a36c26 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.121179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89582ef-ea0e-4c93-a0ca-a4d8431f07cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.121776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89582ef-ea0e-4c93-a0ca-a4d8431f07cb admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.122130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89582ef-ea0e-4c93-a0ca-a4d8431f07cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.122427 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89582ef-ea0e-4c93-a0ca-a4d8431f07cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.123060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89582ef-ea0e-4c93-a0ca-a4d8431f07cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.125573 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89582ef-ea0e-4c93-a0ca-a4d8431f07cb admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.136053 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1334/2639] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:48.140281 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9991a9b-d85d-4eb8-b442-4af6d69374e7 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.150557 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9991a9b-d85d-4eb8-b442-4af6d69374e7 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.155334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0707b6-37fe-4824-9879-53ae3d57e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.155966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0707b6-37fe-4824-9879-53ae3d57e807 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.156276 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0707b6-37fe-4824-9879-53ae3d57e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.156635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0707b6-37fe-4824-9879-53ae3d57e807 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.157285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0707b6-37fe-4824-9879-53ae3d57e807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.158890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0707b6-37fe-4824-9879-53ae3d57e807 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.169780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1306/2640] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:48.174933 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89582ef-ea0e-4c93-a0ca-a4d8431f07cb admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.185118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89582ef-ea0e-4c93-a0ca-a4d8431f07cb admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.190528 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac657213-1cef-4815-a96c-377784a671d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.191116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac657213-1cef-4815-a96c-377784a671d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.191438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac657213-1cef-4815-a96c-377784a671d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.191718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac657213-1cef-4815-a96c-377784a671d4 admin admin] PATH_INFO: `/v3/projects/367e489e671c4b3eab20e485eb414512/users/27b991bb222d434db1e9db97ce01b0e5/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.206977 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac657213-1cef-4815-a96c-377784a671d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367e489e671c4b3eab20e485eb414512, user_id=27b991bb222d434db1e9db97ce01b0e5, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.209757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac657213-1cef-4815-a96c-377784a671d4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.260283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1335/2641] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:48 2022] PUT /identity/v3/projects/367e489e671c4b3eab20e485eb414512/users/27b991bb222d434db1e9db97ce01b0e5/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:48.271780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f85876-6fdd-42e3-9597-0f794d728c19 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.272071 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f85876-6fdd-42e3-9597-0f794d728c19 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.272349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f85876-6fdd-42e3-9597-0f794d728c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.301178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-85f85876-6fdd-42e3-9597-0f794d728c19 None None] MFA Rules not processed for user `27b991bb222d434db1e9db97ce01b0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:48.302385 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-85f85876-6fdd-42e3-9597-0f794d728c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.367769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1307/2642] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:48.372284 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac657213-1cef-4815-a96c-377784a671d4 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.433326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac657213-1cef-4815-a96c-377784a671d4 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.438334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21959ad-494a-4415-9721-330c6dedd3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.438928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21959ad-494a-4415-9721-330c6dedd3ae admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.439207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21959ad-494a-4415-9721-330c6dedd3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.439535 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21959ad-494a-4415-9721-330c6dedd3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.440154 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21959ad-494a-4415-9721-330c6dedd3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.442080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21959ad-494a-4415-9721-330c6dedd3ae admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.537425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1336/2643] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:48.541470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f85876-6fdd-42e3-9597-0f794d728c19 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.553251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f85876-6fdd-42e3-9597-0f794d728c19 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.580202 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:48.610754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b13f5-a266-458b-b2a9-3d9713e2e935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.611409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b13f5-a266-458b-b2a9-3d9713e2e935 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.611692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b13f5-a266-458b-b2a9-3d9713e2e935 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.611970 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b13f5-a266-458b-b2a9-3d9713e2e935 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.612619 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b13f5-a266-458b-b2a9-3d9713e2e935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.614612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b13f5-a266-458b-b2a9-3d9713e2e935 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.694790 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1308/2644] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:48.698765 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21959ad-494a-4415-9721-330c6dedd3ae admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.709743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21959ad-494a-4415-9721-330c6dedd3ae admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.714320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e7427-2a67-4625-914b-81cb60702773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.714906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7427-2a67-4625-914b-81cb60702773 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.715190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7427-2a67-4625-914b-81cb60702773 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.715492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7427-2a67-4625-914b-81cb60702773 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.716122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e7427-2a67-4625-914b-81cb60702773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.717686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e7427-2a67-4625-914b-81cb60702773 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.729665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1337/2645] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:48.733555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b13f5-a266-458b-b2a9-3d9713e2e935 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.743680 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b13f5-a266-458b-b2a9-3d9713e2e935 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.748313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6583f8b-502f-49d3-9e26-37cf2c109213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.748903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6583f8b-502f-49d3-9e26-37cf2c109213 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.749185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6583f8b-502f-49d3-9e26-37cf2c109213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.749650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6583f8b-502f-49d3-9e26-37cf2c109213 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.750318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6583f8b-502f-49d3-9e26-37cf2c109213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.751966 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6583f8b-502f-49d3-9e26-37cf2c109213 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.762007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1309/2646] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:48.766577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e7427-2a67-4625-914b-81cb60702773 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.776324 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e7427-2a67-4625-914b-81cb60702773 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.781435 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002a02c-960d-4e7f-994b-c666a8657743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.782067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002a02c-960d-4e7f-994b-c666a8657743 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.782345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002a02c-960d-4e7f-994b-c666a8657743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.782618 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002a02c-960d-4e7f-994b-c666a8657743 admin admin] PATH_INFO: `/v3/projects/79e0e468c83149ffbbfef87dc8c0c191/users/3a9c559ccd484e01acf82908d0212411/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.796898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002a02c-960d-4e7f-994b-c666a8657743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e0e468c83149ffbbfef87dc8c0c191, user_id=3a9c559ccd484e01acf82908d0212411, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.799626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002a02c-960d-4e7f-994b-c666a8657743 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.866479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1338/2647] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:48 2022] PUT /identity/v3/projects/79e0e468c83149ffbbfef87dc8c0c191/users/3a9c559ccd484e01acf82908d0212411/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:48.876689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e1430-d8d7-4783-afe6-92c4a4f07186 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.876983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e1430-d8d7-4783-afe6-92c4a4f07186 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.877264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e1430-d8d7-4783-afe6-92c4a4f07186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.905175 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-412e1430-d8d7-4783-afe6-92c4a4f07186 None None] MFA Rules not processed for user `3a9c559ccd484e01acf82908d0212411`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:48.907078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-412e1430-d8d7-4783-afe6-92c4a4f07186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.974257 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1310/2648] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:48.978715 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002a02c-960d-4e7f-994b-c666a8657743 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.019246 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:49.041173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002a02c-960d-4e7f-994b-c666a8657743 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.045871 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeab99b-3ffe-4817-97d4-f601d7209881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.046503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeab99b-3ffe-4817-97d4-f601d7209881 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.046776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeab99b-3ffe-4817-97d4-f601d7209881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.047049 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeab99b-3ffe-4817-97d4-f601d7209881 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.047733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeab99b-3ffe-4817-97d4-f601d7209881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.049979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeab99b-3ffe-4817-97d4-f601d7209881 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.122972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1339/2649] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:49.127698 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e1430-d8d7-4783-afe6-92c4a4f07186 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.138414 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e1430-d8d7-4783-afe6-92c4a4f07186 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.195599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f55814-1ab9-41c5-9de0-b9dd7bbf3ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.196206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55814-1ab9-41c5-9de0-b9dd7bbf3ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.196489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55814-1ab9-41c5-9de0-b9dd7bbf3ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.196762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f55814-1ab9-41c5-9de0-b9dd7bbf3ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.197387 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f55814-1ab9-41c5-9de0-b9dd7bbf3ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.199313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f55814-1ab9-41c5-9de0-b9dd7bbf3ce9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.324091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1311/2650] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:49 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:49.328400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeab99b-3ffe-4817-97d4-f601d7209881 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.338912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeab99b-3ffe-4817-97d4-f601d7209881 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.343635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b21b19-c8b5-44ee-bbd8-e41372e88bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.344094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b21b19-c8b5-44ee-bbd8-e41372e88bfc admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.344371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b21b19-c8b5-44ee-bbd8-e41372e88bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.344674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b21b19-c8b5-44ee-bbd8-e41372e88bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.345350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b21b19-c8b5-44ee-bbd8-e41372e88bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.346956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b21b19-c8b5-44ee-bbd8-e41372e88bfc admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.357035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1340/2651] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:49.361766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f55814-1ab9-41c5-9de0-b9dd7bbf3ce9 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.371771 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f55814-1ab9-41c5-9de0-b9dd7bbf3ce9 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.377178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41260b3-3d17-4694-9f7d-3055b108bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.377816 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41260b3-3d17-4694-9f7d-3055b108bec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.378093 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41260b3-3d17-4694-9f7d-3055b108bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.378366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41260b3-3d17-4694-9f7d-3055b108bec9 admin admin] PATH_INFO: `/v3/projects/895f0a15e114461db61657af6e016493/users/9b0fc98139c745f88720ee0ea38aa8e4/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.393021 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41260b3-3d17-4694-9f7d-3055b108bec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895f0a15e114461db61657af6e016493, user_id=9b0fc98139c745f88720ee0ea38aa8e4, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.395778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41260b3-3d17-4694-9f7d-3055b108bec9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.460430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1312/2652] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:49 2022] PUT /identity/v3/projects/895f0a15e114461db61657af6e016493/users/9b0fc98139c745f88720ee0ea38aa8e4/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:49.464345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b21b19-c8b5-44ee-bbd8-e41372e88bfc admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.474721 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b21b19-c8b5-44ee-bbd8-e41372e88bfc admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.530270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2df1e3-1f3d-4acb-a447-f33532ddd670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.530869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2df1e3-1f3d-4acb-a447-f33532ddd670 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.531151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2df1e3-1f3d-4acb-a447-f33532ddd670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.531455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2df1e3-1f3d-4acb-a447-f33532ddd670 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.532088 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2df1e3-1f3d-4acb-a447-f33532ddd670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.533673 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2df1e3-1f3d-4acb-a447-f33532ddd670 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.543134 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1341/2653] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:49.547814 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41260b3-3d17-4694-9f7d-3055b108bec9 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.553264 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:49.558684 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41260b3-3d17-4694-9f7d-3055b108bec9 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.564190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0af73-aec1-4009-af43-297d74be73bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.568615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0af73-aec1-4009-af43-297d74be73bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.568615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0af73-aec1-4009-af43-297d74be73bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.568615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0af73-aec1-4009-af43-297d74be73bb admin admin] PATH_INFO: `/v3/projects/895f0a15e114461db61657af6e016493/users/9b0fc98139c745f88720ee0ea38aa8e4/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.568615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0af73-aec1-4009-af43-297d74be73bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=895f0a15e114461db61657af6e016493, user_id=9b0fc98139c745f88720ee0ea38aa8e4, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.570027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0af73-aec1-4009-af43-297d74be73bb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.580411 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1313/2654] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:49 2022] PUT /identity/v3/projects/895f0a15e114461db61657af6e016493/users/9b0fc98139c745f88720ee0ea38aa8e4/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:49.591270 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383eb320-fb2b-4f4b-8db6-ace056b7de62 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.591590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383eb320-fb2b-4f4b-8db6-ace056b7de62 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.591872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383eb320-fb2b-4f4b-8db6-ace056b7de62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.620390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-383eb320-fb2b-4f4b-8db6-ace056b7de62 None None] MFA Rules not processed for user `9b0fc98139c745f88720ee0ea38aa8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:49.621609 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-383eb320-fb2b-4f4b-8db6-ace056b7de62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:49.689035 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1342/2655] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:49.699866 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0af73-aec1-4009-af43-297d74be73bb admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.701786 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9be0af73-aec1-4009-af43-297d74be73bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:49.765240 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0af73-aec1-4009-af43-297d74be73bb admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.768971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320533e1-4c76-47c0-9e84-80e7ff7ad589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.774827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320533e1-4c76-47c0-9e84-80e7ff7ad589 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.774827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320533e1-4c76-47c0-9e84-80e7ff7ad589 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.774827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320533e1-4c76-47c0-9e84-80e7ff7ad589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.779170 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320533e1-4c76-47c0-9e84-80e7ff7ad589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.781367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320533e1-4c76-47c0-9e84-80e7ff7ad589 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.791042 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1314/2656] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:50.679414 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383eb320-fb2b-4f4b-8db6-ace056b7de62 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:50.680892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-383eb320-fb2b-4f4b-8db6-ace056b7de62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:50.692972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383eb320-fb2b-4f4b-8db6-ace056b7de62 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:50.696519 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf06ed-9cfb-4bf2-80bb-eea74110e859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:50.697118 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf06ed-9cfb-4bf2-80bb-eea74110e859 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:50.697401 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf06ed-9cfb-4bf2-80bb-eea74110e859 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:50.697676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf06ed-9cfb-4bf2-80bb-eea74110e859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:50.728189 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:50.756171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf06ed-9cfb-4bf2-80bb-eea74110e859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:50.757757 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf06ed-9cfb-4bf2-80bb-eea74110e859 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:50.768084 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1343/2657] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:55.411638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320533e1-4c76-47c0-9e84-80e7ff7ad589 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:55.420356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320533e1-4c76-47c0-9e84-80e7ff7ad589 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:55.424022 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c540e6-c469-420d-bff7-7fe376cf0d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:55.424611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c540e6-c469-420d-bff7-7fe376cf0d9d service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:55.424889 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c540e6-c469-420d-bff7-7fe376cf0d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:55.425160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c540e6-c469-420d-bff7-7fe376cf0d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:55.482162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c540e6-c469-420d-bff7-7fe376cf0d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:55.483645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c540e6-c469-420d-bff7-7fe376cf0d9d service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:55.492648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1315/2658] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:59.391654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf06ed-9cfb-4bf2-80bb-eea74110e859 service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:59.400987 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf06ed-9cfb-4bf2-80bb-eea74110e859 service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:59.404850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d814b1-5b08-43c9-a877-c10547a22827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:59.405453 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d814b1-5b08-43c9-a877-c10547a22827 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:59.405735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d814b1-5b08-43c9-a877-c10547a22827 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:59.406006 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d814b1-5b08-43c9-a877-c10547a22827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:59.408098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c540e6-c469-420d-bff7-7fe376cf0d9d service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:59.409577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-04d814b1-5b08-43c9-a877-c10547a22827 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:59.477244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c540e6-c469-420d-bff7-7fe376cf0d9d service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:59.481846 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:59.482470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:59.482755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:59.483027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] PATH_INFO: `/v3/users/27b991bb222d434db1e9db97ce01b0e5` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:59.484181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b991bb222d434db1e9db97ce01b0e5)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:59.486249 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:59.504800 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d814b1-5b08-43c9-a877-c10547a22827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:59.506511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d814b1-5b08-43c9-a877-c10547a22827 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:59.528843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1344/2659] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:59.667801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:59.680153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b991bb222d434db1e9db97ce01b0e5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:59.680799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b991bb222d434db1e9db97ce01b0e5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:59.681394 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b991bb222d434db1e9db97ce01b0e5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:59.693778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b991bb222d434db1e9db97ce01b0e5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:59.767578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b991bb222d434db1e9db97ce01b0e5'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:59.781652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1316/2660] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:59 2022] DELETE /identity/v3/users/27b991bb222d434db1e9db97ce01b0e5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:59.786016 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc4879-1adf-41ac-8f28-fdc97e1c24c5 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:59.786308 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc4879-1adf-41ac-8f28-fdc97e1c24c5 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:59.786583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc4879-1adf-41ac-8f28-fdc97e1c24c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:59.805607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-2edc4879-1adf-41ac-8f28-fdc97e1c24c5 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:59.806751 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2edc4879-1adf-41ac-8f28-fdc97e1c24c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:59.868702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1345/2661] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:59.878518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:59.881018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:59.944187 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad057e2f-21a1-4acc-9259-568dac270272 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:59.947938 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4927a4-7e55-4e7d-a1ac-0e196da1a741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:59.949520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4927a4-7e55-4e7d-a1ac-0e196da1a741 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:59.949520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4927a4-7e55-4e7d-a1ac-0e196da1a741 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:59.949520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4927a4-7e55-4e7d-a1ac-0e196da1a741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:59.959753 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4927a4-7e55-4e7d-a1ac-0e196da1a741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:59.961198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4927a4-7e55-4e7d-a1ac-0e196da1a741 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:59.971066 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1317/2662] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:00.366085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc4879-1adf-41ac-8f28-fdc97e1c24c5 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:00.367863 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-2edc4879-1adf-41ac-8f28-fdc97e1c24c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:00.384111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc4879-1adf-41ac-8f28-fdc97e1c24c5 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:00.387932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4927a4-7e55-4e7d-a1ac-0e196da1a741 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:00.389318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6c4927a4-7e55-4e7d-a1ac-0e196da1a741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:00.390281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:00.391203 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:00.391859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:00.392404 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] PATH_INFO: `/v3/projects/367e489e671c4b3eab20e485eb414512` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:00.393660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=367e489e671c4b3eab20e485eb414512)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:00.397420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:00.449739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4927a4-7e55-4e7d-a1ac-0e196da1a741 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:00.453448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a151ad-b2a4-4721-badc-1c9052c35a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:00.454052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a151ad-b2a4-4721-badc-1c9052c35a6e service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:00.454337 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a151ad-b2a4-4721-badc-1c9052c35a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:00.454609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a151ad-b2a4-4721-badc-1c9052c35a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:00.456439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-13a151ad-b2a4-4721-badc-1c9052c35a6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:00.526176 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:00.530921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a151ad-b2a4-4721-badc-1c9052c35a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:00.531480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:00.532649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a151ad-b2a4-4721-badc-1c9052c35a6e service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:00.544780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1318/2663] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:00.546964 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367e489e671c4b3eab20e485eb414512', 'request_id': 'req-1dd638e4-78db-4b7e-b023-9482a20fdae0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.553488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367e489e671c4b3eab20e485eb414512', 'request_id': 'req-1dd638e4-78db-4b7e-b023-9482a20fdae0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.649207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367e489e671c4b3eab20e485eb414512', 'request_id': 'req-1dd638e4-78db-4b7e-b023-9482a20fdae0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.663374 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] The token cache is being invalidate because project 367e489e671c4b3eab20e485eb414512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:00.663740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.664402 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:00.666165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1346/2664] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:00 2022] DELETE /identity/v3/projects/367e489e671c4b3eab20e485eb414512 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:00.671221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a151ad-b2a4-4721-badc-1c9052c35a6e service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:00.682190 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a151ad-b2a4-4721-badc-1c9052c35a6e service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:00.745964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:00.746599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:00.746921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:00.747224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] PATH_INFO: `/v3/users/3a9c559ccd484e01acf82908d0212411` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:00.748402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a9c559ccd484e01acf82908d0212411)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:00.750391 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:01.022358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a9c559ccd484e01acf82908d0212411'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.023024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a9c559ccd484e01acf82908d0212411'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.023662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a9c559ccd484e01acf82908d0212411'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.035767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a9c559ccd484e01acf82908d0212411'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.146520 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a9c559ccd484e01acf82908d0212411'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.159527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1319/2665] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:00 2022] DELETE /identity/v3/users/3a9c559ccd484e01acf82908d0212411 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:01.617601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:01.619100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:01.633192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd638e4-78db-4b7e-b023-9482a20fdae0 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:01.693147 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:01.693772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:01.694056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:01.694329 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] PATH_INFO: `/v3/projects/79e0e468c83149ffbbfef87dc8c0c191` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:01.695483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e0e468c83149ffbbfef87dc8c0c191)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:01.697429 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:01.837430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e0e468c83149ffbbfef87dc8c0c191', 'request_id': 'req-e57df34a-8b80-4aad-b26f-c853db5120b5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.843725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e0e468c83149ffbbfef87dc8c0c191', 'request_id': 'req-e57df34a-8b80-4aad-b26f-c853db5120b5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.939316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e0e468c83149ffbbfef87dc8c0c191', 'request_id': 'req-e57df34a-8b80-4aad-b26f-c853db5120b5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.950691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] The token cache is being invalidate because project 79e0e468c83149ffbbfef87dc8c0c191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:01.950914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.951580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:01.953063 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1347/2666] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:01 2022] DELETE /identity/v3/projects/79e0e468c83149ffbbfef87dc8c0c191 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:01.957958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:01.959204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:01.973848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e74ef-5d32-4323-9ce1-afe74169ccf7 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:02.032847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:02.033486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:02.033768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:02.034158 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] PATH_INFO: `/v3/users/9b0fc98139c745f88720ee0ea38aa8e4` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:02.035831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0fc98139c745f88720ee0ea38aa8e4)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:02.037770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:02.051806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:02.251848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0fc98139c745f88720ee0ea38aa8e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:02.255362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0fc98139c745f88720ee0ea38aa8e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:02.255362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0fc98139c745f88720ee0ea38aa8e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:02.265803 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0fc98139c745f88720ee0ea38aa8e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:02.340544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-875095f1-a5fd-466a-81d4-fd3774d154c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0fc98139c745f88720ee0ea38aa8e4'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:02.354655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1320/2667] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:01 2022] DELETE /identity/v3/users/9b0fc98139c745f88720ee0ea38aa8e4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:02.816889 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:02.818353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:02.831744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57df34a-8b80-4aad-b26f-c853db5120b5 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:02.879674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:02.892886 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:02.893520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:02.893800 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:02.894069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] PATH_INFO: `/v3/projects/895f0a15e114461db61657af6e016493` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:02.895939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895f0a15e114461db61657af6e016493)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:02.897830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:03.001292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895f0a15e114461db61657af6e016493', 'request_id': 'req-04d3c98b-e540-4b65-9658-0b180711f020'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:03.008050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895f0a15e114461db61657af6e016493', 'request_id': 'req-04d3c98b-e540-4b65-9658-0b180711f020'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:03.077626 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895f0a15e114461db61657af6e016493', 'request_id': 'req-04d3c98b-e540-4b65-9658-0b180711f020'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:03.088881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] The token cache is being invalidate because project 895f0a15e114461db61657af6e016493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:03.089166 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:03.089788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-04d3c98b-e540-4b65-9658-0b180711f020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:03.091265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1348/2668] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:02 2022] DELETE /identity/v3/projects/895f0a15e114461db61657af6e016493 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:03.097128 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a8cf8-11b0-4708-8123-be2d7eec74a7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.098164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a8cf8-11b0-4708-8123-be2d7eec74a7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.098164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a8cf8-11b0-4708-8123-be2d7eec74a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.117143 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-a86a8cf8-11b0-4708-8123-be2d7eec74a7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:03.118363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-a86a8cf8-11b0-4708-8123-be2d7eec74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:03.179606 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1321/2669] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:03.188378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28776-befd-4099-8255-f0eadb636b92 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.188665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28776-befd-4099-8255-f0eadb636b92 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.188942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f28776-befd-4099-8255-f0eadb636b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.210124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b0f28776-befd-4099-8255-f0eadb636b92 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:03.211377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b0f28776-befd-4099-8255-f0eadb636b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:03.219736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1349/2670] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:03.224033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a8cf8-11b0-4708-8123-be2d7eec74a7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:03.234193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a8cf8-11b0-4708-8123-be2d7eec74a7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:03.239521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d14b8-e277-4d7f-a784-536b1808d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:03.240131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d14b8-e277-4d7f-a784-536b1808d410 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.240429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d14b8-e277-4d7f-a784-536b1808d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.240692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d14b8-e277-4d7f-a784-536b1808d410 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.241360 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d14b8-e277-4d7f-a784-536b1808d410 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:03.241663 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d14b8-e277-4d7f-a784-536b1808d410 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:03.243275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d14b8-e277-4d7f-a784-536b1808d410 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:03.256687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1322/2671] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:05:03.261056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28776-befd-4099-8255-f0eadb636b92 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:03.270818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f28776-befd-4099-8255-f0eadb636b92 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:03.275653 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9039841-674f-443e-9964-8bb19f221e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:03.276359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9039841-674f-443e-9964-8bb19f221e86 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.276643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9039841-674f-443e-9964-8bb19f221e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.276917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9039841-674f-443e-9964-8bb19f221e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.277580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9039841-674f-443e-9964-8bb19f221e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:03.279548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9039841-674f-443e-9964-8bb19f221e86 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:03.392322 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1350/2672] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:03 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:03.396855 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d14b8-e277-4d7f-a784-536b1808d410 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:03.406800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d14b8-e277-4d7f-a784-536b1808d410 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:03.467060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06064ee-5eaf-4b69-a0c1-ce37ab06caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:03.467499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06064ee-5eaf-4b69-a0c1-ce37ab06caff admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.467795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06064ee-5eaf-4b69-a0c1-ce37ab06caff admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.468064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06064ee-5eaf-4b69-a0c1-ce37ab06caff admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.468700 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06064ee-5eaf-4b69-a0c1-ce37ab06caff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:03.470960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06064ee-5eaf-4b69-a0c1-ce37ab06caff admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:03.559426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1323/2673] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:03 2022] POST /identity/v3/users => generated 281 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:03.564366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9039841-674f-443e-9964-8bb19f221e86 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:03.579385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9039841-674f-443e-9964-8bb19f221e86 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:03.584864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826f3da-2e62-42bf-a451-58b8683c6f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:03.585526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826f3da-2e62-42bf-a451-58b8683c6f6b admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.585748 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826f3da-2e62-42bf-a451-58b8683c6f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.586054 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826f3da-2e62-42bf-a451-58b8683c6f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.586662 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826f3da-2e62-42bf-a451-58b8683c6f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:03.588275 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826f3da-2e62-42bf-a451-58b8683c6f6b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:03.601307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1351/2674] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:05:03.605331 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06064ee-5eaf-4b69-a0c1-ce37ab06caff admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:03.617334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06064ee-5eaf-4b69-a0c1-ce37ab06caff admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:03.622033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60022963-9e36-4061-9d6e-c8d0ca7f5698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:03.622813 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022963-9e36-4061-9d6e-c8d0ca7f5698 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.623049 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022963-9e36-4061-9d6e-c8d0ca7f5698 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.623417 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022963-9e36-4061-9d6e-c8d0ca7f5698 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.623998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60022963-9e36-4061-9d6e-c8d0ca7f5698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:03.625602 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60022963-9e36-4061-9d6e-c8d0ca7f5698 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:03.629795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:03.643535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1324/2675] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:03.644714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826f3da-2e62-42bf-a451-58b8683c6f6b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:03.656111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826f3da-2e62-42bf-a451-58b8683c6f6b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:03.662893 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d2939-739c-4d00-a814-2e3de9cd7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:03.663612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d2939-739c-4d00-a814-2e3de9cd7f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.663904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d2939-739c-4d00-a814-2e3de9cd7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.664185 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d2939-739c-4d00-a814-2e3de9cd7f87 admin admin] PATH_INFO: `/v3/projects/2c136d81e8734e84b1efdc84cb754e30/users/b95beca3d94d46faa5116c180ac65ff7/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.681613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d2939-739c-4d00-a814-2e3de9cd7f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c136d81e8734e84b1efdc84cb754e30, user_id=b95beca3d94d46faa5116c180ac65ff7, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:03.686007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d2939-739c-4d00-a814-2e3de9cd7f87 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:03.752795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1352/2676] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:03 2022] PUT /identity/v3/projects/2c136d81e8734e84b1efdc84cb754e30/users/b95beca3d94d46faa5116c180ac65ff7/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:03.823084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323db43-3df4-4501-8b05-867cf47759a7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:03.823398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323db43-3df4-4501-8b05-867cf47759a7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:03.823683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323db43-3df4-4501-8b05-867cf47759a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:03.852508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-6323db43-3df4-4501-8b05-867cf47759a7 None None] MFA Rules not processed for user `b95beca3d94d46faa5116c180ac65ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:03.853729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6323db43-3df4-4501-8b05-867cf47759a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:03.920426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1325/2677] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:03.954788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d2939-739c-4d00-a814-2e3de9cd7f87 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:03.956637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-260d2939-739c-4d00-a814-2e3de9cd7f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:04.020708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d2939-739c-4d00-a814-2e3de9cd7f87 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:04.024422 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e2936-b490-47e6-808e-4c8f9a475b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:04.025031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2936-b490-47e6-808e-4c8f9a475b9c service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:04.025312 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2936-b490-47e6-808e-4c8f9a475b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:04.025584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2936-b490-47e6-808e-4c8f9a475b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:04.036980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e2936-b490-47e6-808e-4c8f9a475b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:04.039523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e2936-b490-47e6-808e-4c8f9a475b9c service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:04.047581 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1353/2678] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:04.063231 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323db43-3df4-4501-8b05-867cf47759a7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:04.132070 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323db43-3df4-4501-8b05-867cf47759a7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:04.136993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:04.137632 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:04.137917 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:04.141138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] PATH_INFO: `/v3/users/b95beca3d94d46faa5116c180ac65ff7` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:04.141138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95beca3d94d46faa5116c180ac65ff7)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:04.141478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:04.371262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95beca3d94d46faa5116c180ac65ff7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:04.371933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95beca3d94d46faa5116c180ac65ff7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:04.372534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95beca3d94d46faa5116c180ac65ff7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:04.384824 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95beca3d94d46faa5116c180ac65ff7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:04.454452 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95beca3d94d46faa5116c180ac65ff7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:04.468016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1326/2679] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:04 2022] DELETE /identity/v3/users/b95beca3d94d46faa5116c180ac65ff7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:04.472515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a4fd2-7384-4c51-bbcc-3573200e069c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:04.472939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a4fd2-7384-4c51-bbcc-3573200e069c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:04.473221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a4fd2-7384-4c51-bbcc-3573200e069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:04.492914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-ba5a4fd2-7384-4c51-bbcc-3573200e069c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:04.494190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ba5a4fd2-7384-4c51-bbcc-3573200e069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:04.506430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:04.552636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1354/2680] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:04.562642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:04.564067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:04.574569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:04.621763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b677b3-675a-4078-bf15-3693d4a316cb admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:04.625445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61206f66-83c5-4c04-8e8a-8b5eff395b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:04.626104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61206f66-83c5-4c04-8e8a-8b5eff395b70 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:04.626380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61206f66-83c5-4c04-8e8a-8b5eff395b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:04.626647 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61206f66-83c5-4c04-8e8a-8b5eff395b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:04.637013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61206f66-83c5-4c04-8e8a-8b5eff395b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:04.638472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61206f66-83c5-4c04-8e8a-8b5eff395b70 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:04.648343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1327/2681] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:05.102817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a4fd2-7384-4c51-bbcc-3573200e069c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:05.117843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ba5a4fd2-7384-4c51-bbcc-3573200e069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:05.117843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a4fd2-7384-4c51-bbcc-3573200e069c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:05.123136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:05.124654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.125325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.125672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] PATH_INFO: `/v3/projects/2c136d81e8734e84b1efdc84cb754e30` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.126905 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c136d81e8734e84b1efdc84cb754e30)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:05.129840 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:05.273335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c136d81e8734e84b1efdc84cb754e30', 'request_id': 'req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.279537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c136d81e8734e84b1efdc84cb754e30', 'request_id': 'req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.368007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c136d81e8734e84b1efdc84cb754e30', 'request_id': 'req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.379102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] The token cache is being invalidate because project 2c136d81e8734e84b1efdc84cb754e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:05.379476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.380879 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4ed2aecd-a881-4616-9bfd-6b1ace4ec5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.382381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1355/2682] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:05 2022] DELETE /identity/v3/projects/2c136d81e8734e84b1efdc84cb754e30 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:05.387327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b05f-cca8-49fd-b81a-9074f71bbbf8 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.387809 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b05f-cca8-49fd-b81a-9074f71bbbf8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.387922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b05f-cca8-49fd-b81a-9074f71bbbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.407894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3605b05f-cca8-49fd-b81a-9074f71bbbf8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:05.409019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3605b05f-cca8-49fd-b81a-9074f71bbbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:05.470788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1328/2683] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:05.478980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5316a7-1bad-44df-b0b5-d129b4ac046d None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.479266 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5316a7-1bad-44df-b0b5-d129b4ac046d None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.479570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5316a7-1bad-44df-b0b5-d129b4ac046d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.499716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-fc5316a7-1bad-44df-b0b5-d129b4ac046d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:05.500914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fc5316a7-1bad-44df-b0b5-d129b4ac046d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:05.509205 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1356/2684] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:05.513403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605b05f-cca8-49fd-b81a-9074f71bbbf8 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:05.524392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605b05f-cca8-49fd-b81a-9074f71bbbf8 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:05.529039 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88dbe9-391b-4977-9086-a64894feb4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:05.529635 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88dbe9-391b-4977-9086-a64894feb4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.529926 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88dbe9-391b-4977-9086-a64894feb4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.530210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88dbe9-391b-4977-9086-a64894feb4d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.530863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88dbe9-391b-4977-9086-a64894feb4d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:05.531166 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88dbe9-391b-4977-9086-a64894feb4d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:05.532800 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88dbe9-391b-4977-9086-a64894feb4d2 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:05.549138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1329/2685] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:05:05.550559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5316a7-1bad-44df-b0b5-d129b4ac046d None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:05.560007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5316a7-1bad-44df-b0b5-d129b4ac046d None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:05.565069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb42901-3877-474d-95d3-f21af1519727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:05.565747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb42901-3877-474d-95d3-f21af1519727 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.566026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb42901-3877-474d-95d3-f21af1519727 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.566297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb42901-3877-474d-95d3-f21af1519727 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.566958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb42901-3877-474d-95d3-f21af1519727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:05.569007 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb42901-3877-474d-95d3-f21af1519727 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:05.676632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1357/2686] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:05 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:05.678636 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88dbe9-391b-4977-9086-a64894feb4d2 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:05.689858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88dbe9-391b-4977-9086-a64894feb4d2 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:05.751757 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89a5f-f961-416b-aa13-48ce3998e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:05.752364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89a5f-f961-416b-aa13-48ce3998e307 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.752643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89a5f-f961-416b-aa13-48ce3998e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.752918 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c89a5f-f961-416b-aa13-48ce3998e307 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.753543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89a5f-f961-416b-aa13-48ce3998e307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:05.756138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c89a5f-f961-416b-aa13-48ce3998e307 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:05.837061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1330/2687] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:05 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:05.841037 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb42901-3877-474d-95d3-f21af1519727 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:05.851558 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb42901-3877-474d-95d3-f21af1519727 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:05.856219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d379a-6113-47f5-a963-715783832753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:05.856811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d379a-6113-47f5-a963-715783832753 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.857089 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d379a-6113-47f5-a963-715783832753 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.857359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d379a-6113-47f5-a963-715783832753 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.857988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d379a-6113-47f5-a963-715783832753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:05.859596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d379a-6113-47f5-a963-715783832753 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:05.869599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1358/2688] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:05.873529 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89a5f-f961-416b-aa13-48ce3998e307 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:05.886761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c89a5f-f961-416b-aa13-48ce3998e307 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:05.891762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4914f-8a20-4d5d-b643-8c346734b3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:05.892376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4914f-8a20-4d5d-b643-8c346734b3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.892706 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4914f-8a20-4d5d-b643-8c346734b3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.893009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4914f-8a20-4d5d-b643-8c346734b3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.893952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4914f-8a20-4d5d-b643-8c346734b3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:05.896256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4914f-8a20-4d5d-b643-8c346734b3f2 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:05.907833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1331/2689] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:05.912184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d379a-6113-47f5-a963-715783832753 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:05.922077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d379a-6113-47f5-a963-715783832753 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:05.926963 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745ef69-8958-40aa-b694-cf535df557bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:05.927807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745ef69-8958-40aa-b694-cf535df557bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.928080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745ef69-8958-40aa-b694-cf535df557bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.928349 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745ef69-8958-40aa-b694-cf535df557bd admin admin] PATH_INFO: `/v3/projects/4ad8423539814a73b283fa082d2cda32/users/f39f8f9dfc8c4ca1836f7a74b3d987e0/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.943430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745ef69-8958-40aa-b694-cf535df557bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad8423539814a73b283fa082d2cda32, user_id=f39f8f9dfc8c4ca1836f7a74b3d987e0, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:05.946157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745ef69-8958-40aa-b694-cf535df557bd admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:06.043943 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1359/2690] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:05 2022] PUT /identity/v3/projects/4ad8423539814a73b283fa082d2cda32/users/f39f8f9dfc8c4ca1836f7a74b3d987e0/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:06.054442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4fef4-490a-4b5c-8d26-20f58e25b7c7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:06.054740 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4fef4-490a-4b5c-8d26-20f58e25b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:06.055023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4fef4-490a-4b5c-8d26-20f58e25b7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:06.086413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8df4fef4-490a-4b5c-8d26-20f58e25b7c7 None None] MFA Rules not processed for user `f39f8f9dfc8c4ca1836f7a74b3d987e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:06.087672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8df4fef4-490a-4b5c-8d26-20f58e25b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:06.091820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:06.154858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1332/2691] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:06.167391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745ef69-8958-40aa-b694-cf535df557bd admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:06.169256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6745ef69-8958-40aa-b694-cf535df557bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:06.212940 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:06.228829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745ef69-8958-40aa-b694-cf535df557bd admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:06.232735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf895a23-6c17-4b4c-8973-54fe6c13901b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f436ac7cc2f04919bb0ec1ad9fca5622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:06.233338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf895a23-6c17-4b4c-8973-54fe6c13901b service glance] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:06.233643 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf895a23-6c17-4b4c-8973-54fe6c13901b service glance] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:06.233920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf895a23-6c17-4b4c-8973-54fe6c13901b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:06.242703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf895a23-6c17-4b4c-8973-54fe6c13901b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:06.244173 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf895a23-6c17-4b4c-8973-54fe6c13901b service glance] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:06.255056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1360/2692] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:15.446302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4fef4-490a-4b5c-8d26-20f58e25b7c7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:15.447785 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8df4fef4-490a-4b5c-8d26-20f58e25b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:15.506580 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4fef4-490a-4b5c-8d26-20f58e25b7c7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:15.510226 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97fd5-b367-44d1-a38b-4a8cb4d8390e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:15.510835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97fd5-b367-44d1-a38b-4a8cb4d8390e service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:15.511117 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97fd5-b367-44d1-a38b-4a8cb4d8390e service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:15.511418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97fd5-b367-44d1-a38b-4a8cb4d8390e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:15.513149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-49d97fd5-b367-44d1-a38b-4a8cb4d8390e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:15.582542 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d97fd5-b367-44d1-a38b-4a8cb4d8390e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:15.584236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d97fd5-b367-44d1-a38b-4a8cb4d8390e service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:15.594256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1333/2693] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:16.339071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=9 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:19.375711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf895a23-6c17-4b4c-8973-54fe6c13901b service glance] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:19.377366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-cf895a23-6c17-4b4c-8973-54fe6c13901b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:19.394187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf895a23-6c17-4b4c-8973-54fe6c13901b service glance] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:19.399511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:19.400132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:19.400415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:19.400689 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] PATH_INFO: `/v3/users/601dc79382404e90a6acd32d118d13a5` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:19.401896 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] RBAC: Authorizing `identity:delete_user(user_id=601dc79382404e90a6acd32d118d13a5)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:19.403842 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:19.657165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601dc79382404e90a6acd32d118d13a5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:19.657788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601dc79382404e90a6acd32d118d13a5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:19.658396 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601dc79382404e90a6acd32d118d13a5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:19.741443 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601dc79382404e90a6acd32d118d13a5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:19.754165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-2e8ca904-4491-47cb-819a-9498cd9b26de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601dc79382404e90a6acd32d118d13a5'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:19.767393 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1361/2694] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:19 2022] DELETE /identity/v3/users/601dc79382404e90a6acd32d118d13a5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:20.011649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97fd5-b367-44d1-a38b-4a8cb4d8390e service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:20.022024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97fd5-b367-44d1-a38b-4a8cb4d8390e service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:20.080120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=100 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:20.087511 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:20.089138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.089138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.089138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] PATH_INFO: `/v3/projects/0fc41c8a05be46b8950cfa1808eb5855` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.089908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc41c8a05be46b8950cfa1808eb5855)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:20.091900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:20.221485 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc41c8a05be46b8950cfa1808eb5855', 'request_id': 'req-71ec9838-7646-4439-84ce-9da9115888d1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:20.294346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc41c8a05be46b8950cfa1808eb5855', 'request_id': 'req-71ec9838-7646-4439-84ce-9da9115888d1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:20.301135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc41c8a05be46b8950cfa1808eb5855', 'request_id': 'req-71ec9838-7646-4439-84ce-9da9115888d1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:20.312235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] The token cache is being invalidate because project 0fc41c8a05be46b8950cfa1808eb5855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:20.312531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:20.313178 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-71ec9838-7646-4439-84ce-9da9115888d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:20.314681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1334/2695] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:20 2022] DELETE /identity/v3/projects/0fc41c8a05be46b8950cfa1808eb5855 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:20.320335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740b09d-6301-4c31-a2b7-4582b1a0f89f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.320627 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740b09d-6301-4c31-a2b7-4582b1a0f89f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.320904 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740b09d-6301-4c31-a2b7-4582b1a0f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.340975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d740b09d-6301-4c31-a2b7-4582b1a0f89f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:20.342174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d740b09d-6301-4c31-a2b7-4582b1a0f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:20.403067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1362/2696] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:20.411547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284110de-7f7d-4dae-9c32-dd472f2ae857 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.411831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284110de-7f7d-4dae-9c32-dd472f2ae857 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.412109 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284110de-7f7d-4dae-9c32-dd472f2ae857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.432132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-284110de-7f7d-4dae-9c32-dd472f2ae857 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:20.433310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-284110de-7f7d-4dae-9c32-dd472f2ae857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:20.441346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1335/2697] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:20.446253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740b09d-6301-4c31-a2b7-4582b1a0f89f None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:20.455937 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740b09d-6301-4c31-a2b7-4582b1a0f89f None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:20.460542 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55b27f-8fa9-48d0-8826-7b7d996bf77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:20.461136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55b27f-8fa9-48d0-8826-7b7d996bf77f admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.461438 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55b27f-8fa9-48d0-8826-7b7d996bf77f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.461697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55b27f-8fa9-48d0-8826-7b7d996bf77f admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.462341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55b27f-8fa9-48d0-8826-7b7d996bf77f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:20.462660 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55b27f-8fa9-48d0-8826-7b7d996bf77f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:20.464324 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55b27f-8fa9-48d0-8826-7b7d996bf77f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:20.475883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1363/2698] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:05:20.479944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284110de-7f7d-4dae-9c32-dd472f2ae857 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:20.489565 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284110de-7f7d-4dae-9c32-dd472f2ae857 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:20.494138 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4705250-0b1f-4113-bcc1-47ca6b83fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:20.494723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4705250-0b1f-4113-bcc1-47ca6b83fc40 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.495005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4705250-0b1f-4113-bcc1-47ca6b83fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.495273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4705250-0b1f-4113-bcc1-47ca6b83fc40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.495908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4705250-0b1f-4113-bcc1-47ca6b83fc40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:20.497788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4705250-0b1f-4113-bcc1-47ca6b83fc40 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:20.576742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1336/2699] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:20 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:20.580217 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55b27f-8fa9-48d0-8826-7b7d996bf77f admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:20.590392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55b27f-8fa9-48d0-8826-7b7d996bf77f admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:20.648632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6acb2-25ae-4342-8b8b-27e69d797d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:20.649233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6acb2-25ae-4342-8b8b-27e69d797d00 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.649515 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6acb2-25ae-4342-8b8b-27e69d797d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.649789 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6acb2-25ae-4342-8b8b-27e69d797d00 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.650415 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6acb2-25ae-4342-8b8b-27e69d797d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:20.652365 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6acb2-25ae-4342-8b8b-27e69d797d00 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:20.660094 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:20.749611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1364/2700] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:20 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:20.753723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4705250-0b1f-4113-bcc1-47ca6b83fc40 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:20.764923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4705250-0b1f-4113-bcc1-47ca6b83fc40 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:20.769551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f246d31-6445-4e83-8094-0967074d21d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:20.770368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f246d31-6445-4e83-8094-0967074d21d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.770648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f246d31-6445-4e83-8094-0967074d21d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.770916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f246d31-6445-4e83-8094-0967074d21d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.771628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f246d31-6445-4e83-8094-0967074d21d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:20.773206 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f246d31-6445-4e83-8094-0967074d21d3 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:20.783005 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1337/2701] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:20.788256 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6acb2-25ae-4342-8b8b-27e69d797d00 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:20.798232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6acb2-25ae-4342-8b8b-27e69d797d00 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:20.803664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347f9c6-ffcc-4fba-8f59-121a191523f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:20.804252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347f9c6-ffcc-4fba-8f59-121a191523f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.804536 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347f9c6-ffcc-4fba-8f59-121a191523f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.804819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347f9c6-ffcc-4fba-8f59-121a191523f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.805447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347f9c6-ffcc-4fba-8f59-121a191523f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:20.807047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347f9c6-ffcc-4fba-8f59-121a191523f4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:20.818617 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1365/2702] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:20.822681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f246d31-6445-4e83-8094-0967074d21d3 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:20.833500 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f246d31-6445-4e83-8094-0967074d21d3 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:20.838091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447948-2bb1-4674-9e9b-1137696c6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:20.838734 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447948-2bb1-4674-9e9b-1137696c6d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.839017 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447948-2bb1-4674-9e9b-1137696c6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.839315 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447948-2bb1-4674-9e9b-1137696c6d9d admin admin] PATH_INFO: `/v3/projects/2a393ae61b2c4d67abb247bfac2efa27/users/705adb206ab94f5ea7c93866488bfd75/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.854727 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da447948-2bb1-4674-9e9b-1137696c6d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a393ae61b2c4d67abb247bfac2efa27, user_id=705adb206ab94f5ea7c93866488bfd75, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:20.857439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da447948-2bb1-4674-9e9b-1137696c6d9d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:20.929778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1338/2703] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:20 2022] PUT /identity/v3/projects/2a393ae61b2c4d67abb247bfac2efa27/users/705adb206ab94f5ea7c93866488bfd75/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:20.943915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4ef9f-bbff-4228-a520-332c4ff5f3f6 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:20.944212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4ef9f-bbff-4228-a520-332c4ff5f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:20.944508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4ef9f-bbff-4228-a520-332c4ff5f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:20.971776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f2e4ef9f-bbff-4228-a520-332c4ff5f3f6 None None] MFA Rules not processed for user `705adb206ab94f5ea7c93866488bfd75`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:20.973469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f2e4ef9f-bbff-4228-a520-332c4ff5f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:21.040521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1366/2704] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:21.053965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447948-2bb1-4674-9e9b-1137696c6d9d admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:21.055709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-da447948-2bb1-4674-9e9b-1137696c6d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:21.129867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447948-2bb1-4674-9e9b-1137696c6d9d admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:21.135552 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559774a-98be-42ee-8d57-f5fa254067c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:21.136161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559774a-98be-42ee-8d57-f5fa254067c6 service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:21.136471 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559774a-98be-42ee-8d57-f5fa254067c6 service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:21.136750 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559774a-98be-42ee-8d57-f5fa254067c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:21.144689 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559774a-98be-42ee-8d57-f5fa254067c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:21.147615 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559774a-98be-42ee-8d57-f5fa254067c6 service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:21.156561 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1339/2705] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:27.341116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4ef9f-bbff-4228-a520-332c4ff5f3f6 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:27.404979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4ef9f-bbff-4228-a520-332c4ff5f3f6 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:27.409398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:27.410032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:27.410316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:27.411216 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] PATH_INFO: `/v3/users/705adb206ab94f5ea7c93866488bfd75` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:27.412446 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705adb206ab94f5ea7c93866488bfd75)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:27.414392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:27.604775 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705adb206ab94f5ea7c93866488bfd75'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:27.605416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705adb206ab94f5ea7c93866488bfd75'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:27.606011 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705adb206ab94f5ea7c93866488bfd75'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:27.689756 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705adb206ab94f5ea7c93866488bfd75'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:27.704985 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:27.706734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705adb206ab94f5ea7c93866488bfd75'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:27.720219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1367/2706] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:27 2022] DELETE /identity/v3/users/705adb206ab94f5ea7c93866488bfd75 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:27.725673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2de8-7a88-436f-892a-1aa41f31f749 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:27.726161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2de8-7a88-436f-892a-1aa41f31f749 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:27.726279 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2de8-7a88-436f-892a-1aa41f31f749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:27.739313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:27.745081 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-da7f2de8-7a88-436f-892a-1aa41f31f749 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:27.747765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-da7f2de8-7a88-436f-892a-1aa41f31f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:27.806196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1340/2707] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:27.816252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:27.818261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:27.875747 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b38846-809a-4f16-b97f-03907d7edfb2 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:27.879680 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4268f6b-2285-4790-972a-85c046e8b237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:27.880540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4268f6b-2285-4790-972a-85c046e8b237 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:27.880899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4268f6b-2285-4790-972a-85c046e8b237 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:27.881145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4268f6b-2285-4790-972a-85c046e8b237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:27.890290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4268f6b-2285-4790-972a-85c046e8b237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:27.891772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4268f6b-2285-4790-972a-85c046e8b237 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:27.902025 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1368/2708] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:28.319696 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f2de8-7a88-436f-892a-1aa41f31f749 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:28.321194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-da7f2de8-7a88-436f-892a-1aa41f31f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:28.336040 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f2de8-7a88-436f-892a-1aa41f31f749 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:28.341050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:28.341720 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:28.342086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:28.342498 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] PATH_INFO: `/v3/projects/2a393ae61b2c4d67abb247bfac2efa27` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:28.344459 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a393ae61b2c4d67abb247bfac2efa27)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:28.346519 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:28.443739 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a393ae61b2c4d67abb247bfac2efa27', 'request_id': 'req-10c7009b-1f35-4ceb-a47c-87acd702a5d9'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:28.534783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a393ae61b2c4d67abb247bfac2efa27', 'request_id': 'req-10c7009b-1f35-4ceb-a47c-87acd702a5d9'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:28.545607 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a393ae61b2c4d67abb247bfac2efa27', 'request_id': 'req-10c7009b-1f35-4ceb-a47c-87acd702a5d9'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:28.556783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] The token cache is being invalidate because project 2a393ae61b2c4d67abb247bfac2efa27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:28.557077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:28.557721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-10c7009b-1f35-4ceb-a47c-87acd702a5d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:28.559201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1341/2709] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:28 2022] DELETE /identity/v3/projects/2a393ae61b2c4d67abb247bfac2efa27 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:28.564636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a519861-2e28-4819-9aaa-f5aa576c608c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:28.565137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a519861-2e28-4819-9aaa-f5aa576c608c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:28.565137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a519861-2e28-4819-9aaa-f5aa576c608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:28.585823 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-1a519861-2e28-4819-9aaa-f5aa576c608c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:28.587102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-1a519861-2e28-4819-9aaa-f5aa576c608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:28.651119 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1369/2710] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:28.659065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9856a3-a3b8-45aa-8ac6-396ab30f5a53 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:28.659380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9856a3-a3b8-45aa-8ac6-396ab30f5a53 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:28.659681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9856a3-a3b8-45aa-8ac6-396ab30f5a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:28.679925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3e9856a3-a3b8-45aa-8ac6-396ab30f5a53 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:28.681469 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3e9856a3-a3b8-45aa-8ac6-396ab30f5a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:28.689903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1342/2711] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:28.694890 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a519861-2e28-4819-9aaa-f5aa576c608c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:28.704622 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a519861-2e28-4819-9aaa-f5aa576c608c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:28.709701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a79b-089e-4804-b73b-7eb66a4eeacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:28.710297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a79b-089e-4804-b73b-7eb66a4eeacb admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:28.710575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a79b-089e-4804-b73b-7eb66a4eeacb admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:28.710848 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a79b-089e-4804-b73b-7eb66a4eeacb admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:28.711526 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9a79b-089e-4804-b73b-7eb66a4eeacb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:28.711828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9a79b-089e-4804-b73b-7eb66a4eeacb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:28.713417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9a79b-089e-4804-b73b-7eb66a4eeacb admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:28.726755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1370/2712] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:05:28.731000 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9856a3-a3b8-45aa-8ac6-396ab30f5a53 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:28.741029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9856a3-a3b8-45aa-8ac6-396ab30f5a53 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:28.747388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d080869-4c97-4a28-9aaa-69a3bd1eab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:28.747388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d080869-4c97-4a28-9aaa-69a3bd1eab4d admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:28.747388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d080869-4c97-4a28-9aaa-69a3bd1eab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:28.747388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d080869-4c97-4a28-9aaa-69a3bd1eab4d admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:28.747780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d080869-4c97-4a28-9aaa-69a3bd1eab4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:28.749453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d080869-4c97-4a28-9aaa-69a3bd1eab4d admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:28.832930 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1343/2713] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:28 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:28.836820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a79b-089e-4804-b73b-7eb66a4eeacb admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:28.846791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a79b-089e-4804-b73b-7eb66a4eeacb admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:28.908750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002bca0-766b-49ad-b347-42efb9660cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:28.909367 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002bca0-766b-49ad-b347-42efb9660cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:28.909681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002bca0-766b-49ad-b347-42efb9660cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:28.909966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002bca0-766b-49ad-b347-42efb9660cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:28.910624 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002bca0-766b-49ad-b347-42efb9660cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:28.912588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002bca0-766b-49ad-b347-42efb9660cf8 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:29.007085 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1371/2714] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:28 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:29.009454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d080869-4c97-4a28-9aaa-69a3bd1eab4d admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:29.021402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d080869-4c97-4a28-9aaa-69a3bd1eab4d admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:29.028200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0074211-f7e4-41e9-8acb-6958a97cf29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:29.029137 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074211-f7e4-41e9-8acb-6958a97cf29e admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:29.029748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074211-f7e4-41e9-8acb-6958a97cf29e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:29.030160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0074211-f7e4-41e9-8acb-6958a97cf29e admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:29.030964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0074211-f7e4-41e9-8acb-6958a97cf29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:29.032673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0074211-f7e4-41e9-8acb-6958a97cf29e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:29.045219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1344/2715] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:29.049107 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002bca0-766b-49ad-b347-42efb9660cf8 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:29.060282 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002bca0-766b-49ad-b347-42efb9660cf8 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:29.065236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26bc31-379c-4480-a47e-0dcfab5e9ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:29.065834 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26bc31-379c-4480-a47e-0dcfab5e9ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:29.066117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26bc31-379c-4480-a47e-0dcfab5e9ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:29.066394 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26bc31-379c-4480-a47e-0dcfab5e9ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:29.067066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26bc31-379c-4480-a47e-0dcfab5e9ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:29.068702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26bc31-379c-4480-a47e-0dcfab5e9ca1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:29.069956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:29.079732 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1372/2716] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:29.083932 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0074211-f7e4-41e9-8acb-6958a97cf29e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:29.094041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0074211-f7e4-41e9-8acb-6958a97cf29e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:29.099338 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4eb99-79d1-43c7-8bc6-0ed908560cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:29.099989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4eb99-79d1-43c7-8bc6-0ed908560cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:29.100272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4eb99-79d1-43c7-8bc6-0ed908560cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:29.100548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4eb99-79d1-43c7-8bc6-0ed908560cfb admin admin] PATH_INFO: `/v3/projects/9e03f514a99a436a88ade49b53eeb8c1/users/60aeb303af584afb8b4bc1c3c18cfaf2/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:29.116014 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4eb99-79d1-43c7-8bc6-0ed908560cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e03f514a99a436a88ade49b53eeb8c1, user_id=60aeb303af584afb8b4bc1c3c18cfaf2, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:29.118760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4eb99-79d1-43c7-8bc6-0ed908560cfb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:29.181377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1345/2717] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:29 2022] PUT /identity/v3/projects/9e03f514a99a436a88ade49b53eeb8c1/users/60aeb303af584afb8b4bc1c3c18cfaf2/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:29.192211 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae4e72-506c-4796-8d3a-44e26f324eb9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:29.192533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae4e72-506c-4796-8d3a-44e26f324eb9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:29.192818 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae4e72-506c-4796-8d3a-44e26f324eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:29.220648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-bdae4e72-506c-4796-8d3a-44e26f324eb9 None None] MFA Rules not processed for user `60aeb303af584afb8b4bc1c3c18cfaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:29.222015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-bdae4e72-506c-4796-8d3a-44e26f324eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:29.290378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1373/2718] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:29.302931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4eb99-79d1-43c7-8bc6-0ed908560cfb admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:29.304764 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b0b4eb99-79d1-43c7-8bc6-0ed908560cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:29.336742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:29.380964 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4eb99-79d1-43c7-8bc6-0ed908560cfb admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:29.386556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00eac6-273a-483b-89d0-a811fabe1a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:29.387161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00eac6-273a-483b-89d0-a811fabe1a4f service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:29.387475 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00eac6-273a-483b-89d0-a811fabe1a4f service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:29.387761 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00eac6-273a-483b-89d0-a811fabe1a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:29.396433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00eac6-273a-483b-89d0-a811fabe1a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:29.399091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00eac6-273a-483b-89d0-a811fabe1a4f service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:29.408019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1346/2719] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:32.625686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae4e72-506c-4796-8d3a-44e26f324eb9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:32.690163 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae4e72-506c-4796-8d3a-44e26f324eb9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:32.695787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:32.696442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:32.696724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:32.697002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] PATH_INFO: `/v3/users/60aeb303af584afb8b4bc1c3c18cfaf2` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:32.698171 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60aeb303af584afb8b4bc1c3c18cfaf2)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:32.700334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:32.851017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60aeb303af584afb8b4bc1c3c18cfaf2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:32.851691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60aeb303af584afb8b4bc1c3c18cfaf2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:32.852295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60aeb303af584afb8b4bc1c3c18cfaf2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:32.899669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60aeb303af584afb8b4bc1c3c18cfaf2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:32.912779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60aeb303af584afb8b4bc1c3c18cfaf2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:32.925669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1374/2720] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:32 2022] DELETE /identity/v3/users/60aeb303af584afb8b4bc1c3c18cfaf2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:32.930758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9a46-850e-4878-af08-eeef930710d4 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:32.931232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9a46-850e-4878-af08-eeef930710d4 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:32.931364 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb9a46-850e-4878-af08-eeef930710d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:32.950555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-29cb9a46-850e-4878-af08-eeef930710d4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:32.951783 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-29cb9a46-850e-4878-af08-eeef930710d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:33.011122 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1347/2721] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:33.021060 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:33.022483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:33.029174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:33.080406 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877c366-3125-4d93-ad14-483a1da4e472 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:33.084911 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f92c70-2e47-4bb2-9c28-7f621d85c07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:33.085544 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f92c70-2e47-4bb2-9c28-7f621d85c07c service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:33.085835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f92c70-2e47-4bb2-9c28-7f621d85c07c service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:33.086114 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f92c70-2e47-4bb2-9c28-7f621d85c07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:33.095873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f92c70-2e47-4bb2-9c28-7f621d85c07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:33.099853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f92c70-2e47-4bb2-9c28-7f621d85c07c service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:33.107858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1375/2722] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:33.576428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb9a46-850e-4878-af08-eeef930710d4 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:33.577937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-29cb9a46-850e-4878-af08-eeef930710d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:33.591465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb9a46-850e-4878-af08-eeef930710d4 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:33.596305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:33.596937 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:33.598104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:33.598104 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] PATH_INFO: `/v3/projects/9e03f514a99a436a88ade49b53eeb8c1` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:33.598629 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e03f514a99a436a88ade49b53eeb8c1)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:33.601111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:33.689446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e03f514a99a436a88ade49b53eeb8c1', 'request_id': 'req-8f077579-8e5e-4f3e-a9a6-639c49572d9a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:33.749608 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e03f514a99a436a88ade49b53eeb8c1', 'request_id': 'req-8f077579-8e5e-4f3e-a9a6-639c49572d9a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:33.756409 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e03f514a99a436a88ade49b53eeb8c1', 'request_id': 'req-8f077579-8e5e-4f3e-a9a6-639c49572d9a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:33.766988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] The token cache is being invalidate because project 9e03f514a99a436a88ade49b53eeb8c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:33.767277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:33.767936 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:33.769420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1348/2723] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:33 2022] DELETE /identity/v3/projects/9e03f514a99a436a88ade49b53eeb8c1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:33.774475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8a52-b1fc-4bc2-9827-b6c6c8e084ba None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:33.774974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8a52-b1fc-4bc2-9827-b6c6c8e084ba None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:33.775072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8a52-b1fc-4bc2-9827-b6c6c8e084ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:33.796592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-9dde8a52-b1fc-4bc2-9827-b6c6c8e084ba None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:33.797787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9dde8a52-b1fc-4bc2-9827-b6c6c8e084ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:33.859701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1376/2724] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:33.860582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:33.862050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:33.867260 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261e55f-d0aa-4ff0-a7ea-4c397bd0548c None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:33.867578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261e55f-d0aa-4ff0-a7ea-4c397bd0548c None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:33.867853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261e55f-d0aa-4ff0-a7ea-4c397bd0548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:33.877020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f077579-8e5e-4f3e-a9a6-639c49572d9a admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:33.881962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:33.882585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:33.882862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:33.883132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] PATH_INFO: `/v3/users/f39f8f9dfc8c4ca1836f7a74b3d987e0` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:33.884291 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39f8f9dfc8c4ca1836f7a74b3d987e0)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:33.886316 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:33.887635 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8261e55f-d0aa-4ff0-a7ea-4c397bd0548c None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:33.888843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8261e55f-d0aa-4ff0-a7ea-4c397bd0548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:33.897824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1377/2725] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:33.908387 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261e55f-d0aa-4ff0-a7ea-4c397bd0548c None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:33.910787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261e55f-d0aa-4ff0-a7ea-4c397bd0548c None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:33.916678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e6a5e-cc11-478b-bcc8-11e81ebef4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:33.917264 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e6a5e-cc11-478b-bcc8-11e81ebef4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:33.917551 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e6a5e-cc11-478b-bcc8-11e81ebef4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:33.917822 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e6a5e-cc11-478b-bcc8-11e81ebef4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:33.918455 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e6a5e-cc11-478b-bcc8-11e81ebef4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:33.918755 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e6a5e-cc11-478b-bcc8-11e81ebef4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:33.920366 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e6a5e-cc11-478b-bcc8-11e81ebef4b1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:33.932483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1378/2726] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:05:33.936697 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e6a5e-cc11-478b-bcc8-11e81ebef4b1 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:33.946877 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e6a5e-cc11-478b-bcc8-11e81ebef4b1 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:33.951467 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fda0b-838f-4555-aed0-00d709f61a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:33.952033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fda0b-838f-4555-aed0-00d709f61a66 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:33.952307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fda0b-838f-4555-aed0-00d709f61a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:33.952585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fda0b-838f-4555-aed0-00d709f61a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:33.953181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fda0b-838f-4555-aed0-00d709f61a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:33.955140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fda0b-838f-4555-aed0-00d709f61a66 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.076853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1379/2727] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:33 2022] POST /identity/v3/projects => generated 389 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:34.080864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fda0b-838f-4555-aed0-00d709f61a66 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.083925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:34.097220 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39f8f9dfc8c4ca1836f7a74b3d987e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.097895 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39f8f9dfc8c4ca1836f7a74b3d987e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.098543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39f8f9dfc8c4ca1836f7a74b3d987e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.111592 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39f8f9dfc8c4ca1836f7a74b3d987e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.143501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fda0b-838f-4555-aed0-00d709f61a66 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:34.148931 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d27030-b7a1-4e03-9bf6-50fa95625d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:34.149579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27030-b7a1-4e03-9bf6-50fa95625d9c admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.149860 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27030-b7a1-4e03-9bf6-50fa95625d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.150129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d27030-b7a1-4e03-9bf6-50fa95625d9c admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.150903 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d27030-b7a1-4e03-9bf6-50fa95625d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:34.152946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d27030-b7a1-4e03-9bf6-50fa95625d9c admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.164318 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:34.185080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-a91e2b98-0cad-4337-8278-3911f5430763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39f8f9dfc8c4ca1836f7a74b3d987e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.198665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1349/2728] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:33 2022] DELETE /identity/v3/users/f39f8f9dfc8c4ca1836f7a74b3d987e0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:34.202986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f4f8-aff9-4b1d-a8cf-98f2f01a6b54 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.203478 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f4f8-aff9-4b1d-a8cf-98f2f01a6b54 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.203939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f4f8-aff9-4b1d-a8cf-98f2f01a6b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.227111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8243f4f8-aff9-4b1d-a8cf-98f2f01a6b54 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:34.228352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8243f4f8-aff9-4b1d-a8cf-98f2f01a6b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:34.287215 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1350/2729] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:34.289496 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1380/2730] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:34 2022] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:34.293510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243f4f8-aff9-4b1d-a8cf-98f2f01a6b54 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.295247 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8243f4f8-aff9-4b1d-a8cf-98f2f01a6b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:34.297672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d27030-b7a1-4e03-9bf6-50fa95625d9c admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.299295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c7d27030-b7a1-4e03-9bf6-50fa95625d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:34.307572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243f4f8-aff9-4b1d-a8cf-98f2f01a6b54 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:34.312755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931ebe-97fd-4452-884e-c1bcc2a41737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:34.313447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931ebe-97fd-4452-884e-c1bcc2a41737 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.313730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931ebe-97fd-4452-884e-c1bcc2a41737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.314004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38931ebe-97fd-4452-884e-c1bcc2a41737 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.314657 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38931ebe-97fd-4452-884e-c1bcc2a41737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:34.316280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38931ebe-97fd-4452-884e-c1bcc2a41737 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.327050 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1351/2731] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:34.331112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931ebe-97fd-4452-884e-c1bcc2a41737 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.342069 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38931ebe-97fd-4452-884e-c1bcc2a41737 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:34.346993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda16e5-5291-49a5-990e-c236efac910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:34.347672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda16e5-5291-49a5-990e-c236efac910c admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.348002 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda16e5-5291-49a5-990e-c236efac910c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.348285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda16e5-5291-49a5-990e-c236efac910c admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.348904 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda16e5-5291-49a5-990e-c236efac910c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:34.350692 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda16e5-5291-49a5-990e-c236efac910c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.361236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d27030-b7a1-4e03-9bf6-50fa95625d9c admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:34.364349 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1352/2732] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:05:34.369221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda16e5-5291-49a5-990e-c236efac910c admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.379173 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda16e5-5291-49a5-990e-c236efac910c admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:34.385115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1510836-79d5-4b7b-9c04-cc1c3d17088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:34.385795 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1510836-79d5-4b7b-9c04-cc1c3d17088f admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.386079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1510836-79d5-4b7b-9c04-cc1c3d17088f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.386388 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1510836-79d5-4b7b-9c04-cc1c3d17088f admin admin] PATH_INFO: `/v3/projects/59d1cd98ecdf4e83b038cf542cb1d751/users/b66d050be9734edcb0d803c9a3786439/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.402710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1510836-79d5-4b7b-9c04-cc1c3d17088f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d1cd98ecdf4e83b038cf542cb1d751, user_id=b66d050be9734edcb0d803c9a3786439, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:34.405432 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1510836-79d5-4b7b-9c04-cc1c3d17088f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.414051 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d7f77-f086-417c-9ad3-ffa6a71c5ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:34.422066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d7f77-f086-417c-9ad3-ffa6a71c5ebb service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.422066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d7f77-f086-417c-9ad3-ffa6a71c5ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.422066 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d7f77-f086-417c-9ad3-ffa6a71c5ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.424250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d7f77-f086-417c-9ad3-ffa6a71c5ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:34.425676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d7f77-f086-417c-9ad3-ffa6a71c5ebb service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.435157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1381/2733] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:34.477477 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1353/2734] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:34 2022] PUT /identity/v3/projects/59d1cd98ecdf4e83b038cf542cb1d751/users/b66d050be9734edcb0d803c9a3786439/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:34.488996 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd1e2-67aa-4685-9a4c-8fa9a518b2f2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.489281 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd1e2-67aa-4685-9a4c-8fa9a518b2f2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.489557 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd1e2-67aa-4685-9a4c-8fa9a518b2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.518630 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-714bd1e2-67aa-4685-9a4c-8fa9a518b2f2 None None] MFA Rules not processed for user `b66d050be9734edcb0d803c9a3786439`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:34.519906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-714bd1e2-67aa-4685-9a4c-8fa9a518b2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:34.586389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1382/2735] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:34.590985 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1510836-79d5-4b7b-9c04-cc1c3d17088f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.660073 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1510836-79d5-4b7b-9c04-cc1c3d17088f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:34.665246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967d24a-4475-44d2-8a6e-bcdbaab0dde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:34.665958 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967d24a-4475-44d2-8a6e-bcdbaab0dde4 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.666335 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967d24a-4475-44d2-8a6e-bcdbaab0dde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.666704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967d24a-4475-44d2-8a6e-bcdbaab0dde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.667358 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967d24a-4475-44d2-8a6e-bcdbaab0dde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:34.669285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967d24a-4475-44d2-8a6e-bcdbaab0dde4 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.674927 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:34.790988 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1354/2736] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:34 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:34.792182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd1e2-67aa-4685-9a4c-8fa9a518b2f2 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.803681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd1e2-67aa-4685-9a4c-8fa9a518b2f2 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:34.846156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:34.861064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad5e36-195d-4d57-a78e-fea14e2b921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:34.861664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad5e36-195d-4d57-a78e-fea14e2b921a admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.861949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad5e36-195d-4d57-a78e-fea14e2b921a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.862218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad5e36-195d-4d57-a78e-fea14e2b921a admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.862830 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad5e36-195d-4d57-a78e-fea14e2b921a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:34.864790 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad5e36-195d-4d57-a78e-fea14e2b921a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.873456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967d24a-4475-44d2-8a6e-bcdbaab0dde4 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.875377 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9967d24a-4475-44d2-8a6e-bcdbaab0dde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:34.893887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967d24a-4475-44d2-8a6e-bcdbaab0dde4 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:34.901343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:34.901974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.902343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.902582 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] PATH_INFO: `/v3/projects/4ad8423539814a73b283fa082d2cda32` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.903796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad8423539814a73b283fa082d2cda32)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:34.905705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.986720 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1383/2737] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:34 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:34.990554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad5e36-195d-4d57-a78e-fea14e2b921a admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.000854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad5e36-195d-4d57-a78e-fea14e2b921a admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.005497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367efcc6-10c7-4e34-9b1c-8ac6025d4408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.006564 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efcc6-10c7-4e34-9b1c-8ac6025d4408 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.007456 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efcc6-10c7-4e34-9b1c-8ac6025d4408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.007750 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efcc6-10c7-4e34-9b1c-8ac6025d4408 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.008384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367efcc6-10c7-4e34-9b1c-8ac6025d4408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.009979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367efcc6-10c7-4e34-9b1c-8ac6025d4408 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.024258 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1384/2738] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:05:35.025324 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367efcc6-10c7-4e34-9b1c-8ac6025d4408 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.030233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad8423539814a73b283fa082d2cda32', 'request_id': 'req-e8beaf2c-ee82-41ab-a296-2283b2d41699'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:35.034936 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367efcc6-10c7-4e34-9b1c-8ac6025d4408 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.093997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331d50d-a42f-4e19-953b-d4b02c13f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.094642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331d50d-a42f-4e19-953b-d4b02c13f9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.094919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331d50d-a42f-4e19-953b-d4b02c13f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.095189 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331d50d-a42f-4e19-953b-d4b02c13f9a7 admin admin] PATH_INFO: `/v3/projects/791f7b74849941dfabe757ce081645a0/users/0f62d4270ff44b80b14c9816531a75f1/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.108591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331d50d-a42f-4e19-953b-d4b02c13f9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791f7b74849941dfabe757ce081645a0, user_id=0f62d4270ff44b80b14c9816531a75f1, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.111245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331d50d-a42f-4e19-953b-d4b02c13f9a7 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.117589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad8423539814a73b283fa082d2cda32', 'request_id': 'req-e8beaf2c-ee82-41ab-a296-2283b2d41699'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:35.124912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad8423539814a73b283fa082d2cda32', 'request_id': 'req-e8beaf2c-ee82-41ab-a296-2283b2d41699'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:35.136473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] The token cache is being invalidate because project 4ad8423539814a73b283fa082d2cda32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:35.136758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:35.137415 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e8beaf2c-ee82-41ab-a296-2283b2d41699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:35.138910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1355/2739] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:34 2022] DELETE /identity/v3/projects/4ad8423539814a73b283fa082d2cda32 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:35.143641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b2e86-b696-45c3-bbb4-129aa050f757 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.143929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b2e86-b696-45c3-bbb4-129aa050f757 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.144204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b2e86-b696-45c3-bbb4-129aa050f757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.164135 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3f1b2e86-b696-45c3-bbb4-129aa050f757 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:35.165336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3f1b2e86-b696-45c3-bbb4-129aa050f757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:35.173188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1356/2740] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:35.181054 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf10aa-4f0a-4e80-bd32-eefff85293bf None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.181341 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf10aa-4f0a-4e80-bd32-eefff85293bf None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.181618 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf10aa-4f0a-4e80-bd32-eefff85293bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.198248 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1385/2741] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:35 2022] PUT /identity/v3/projects/791f7b74849941dfabe757ce081645a0/users/0f62d4270ff44b80b14c9816531a75f1/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:35.201893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-9cdf10aa-4f0a-4e80-bd32-eefff85293bf None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:35.203152 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9cdf10aa-4f0a-4e80-bd32-eefff85293bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:35.204828 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331d50d-a42f-4e19-953b-d4b02c13f9a7 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.206670 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4331d50d-a42f-4e19-953b-d4b02c13f9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:35.265132 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1357/2742] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:35.269374 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf10aa-4f0a-4e80-bd32-eefff85293bf None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.273628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331d50d-a42f-4e19-953b-d4b02c13f9a7 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.278700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b57617-7b3d-4341-a4fd-54f5325f751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.279331 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b57617-7b3d-4341-a4fd-54f5325f751c admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.279649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b57617-7b3d-4341-a4fd-54f5325f751c admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.279921 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b57617-7b3d-4341-a4fd-54f5325f751c admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.280559 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b57617-7b3d-4341-a4fd-54f5325f751c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.281290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf10aa-4f0a-4e80-bd32-eefff85293bf None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.282215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b57617-7b3d-4341-a4fd-54f5325f751c admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.287029 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5520420-cd3c-4934-b6f1-1c37d5aeb7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.287841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520420-cd3c-4934-b6f1-1c37d5aeb7ea admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.288356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520420-cd3c-4934-b6f1-1c37d5aeb7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.288742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520420-cd3c-4934-b6f1-1c37d5aeb7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.289516 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5520420-cd3c-4934-b6f1-1c37d5aeb7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:35.289867 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5520420-cd3c-4934-b6f1-1c37d5aeb7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.291784 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5520420-cd3c-4934-b6f1-1c37d5aeb7ea admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.293150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1386/2743] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:05:35.297247 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b57617-7b3d-4341-a4fd-54f5325f751c admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.307326 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1358/2744] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:05:35.309555 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b57617-7b3d-4341-a4fd-54f5325f751c admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.313661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5520420-cd3c-4934-b6f1-1c37d5aeb7ea admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.314586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70bbd-833b-4c14-a90d-13de21564de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.315253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70bbd-833b-4c14-a90d-13de21564de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.315602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70bbd-833b-4c14-a90d-13de21564de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.315874 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70bbd-833b-4c14-a90d-13de21564de4 admin admin] PATH_INFO: `/v3/projects/791f7b74849941dfabe757ce081645a0/users/0f62d4270ff44b80b14c9816531a75f1/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.317807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70bbd-833b-4c14-a90d-13de21564de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791f7b74849941dfabe757ce081645a0, user_id=0f62d4270ff44b80b14c9816531a75f1, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.321392 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70bbd-833b-4c14-a90d-13de21564de4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.324660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5520420-cd3c-4934-b6f1-1c37d5aeb7ea admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.329433 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca87f64-68d4-4ff3-8b93-961bc811229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.330025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca87f64-68d4-4ff3-8b93-961bc811229e admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.330309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca87f64-68d4-4ff3-8b93-961bc811229e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.330589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca87f64-68d4-4ff3-8b93-961bc811229e admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.331257 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca87f64-68d4-4ff3-8b93-961bc811229e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.331546 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1387/2745] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:35 2022] PUT /identity/v3/projects/791f7b74849941dfabe757ce081645a0/users/0f62d4270ff44b80b14c9816531a75f1/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:35.333229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca87f64-68d4-4ff3-8b93-961bc811229e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.342883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd29569-db4b-4186-b819-9fb283c9e261 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.343179 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd29569-db4b-4186-b819-9fb283c9e261 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.343483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd29569-db4b-4186-b819-9fb283c9e261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.372803 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-6bd29569-db4b-4186-b819-9fb283c9e261 None None] MFA Rules not processed for user `0f62d4270ff44b80b14c9816531a75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:35.374020 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6bd29569-db4b-4186-b819-9fb283c9e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:35.391295 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:35.409862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1359/2746] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:35 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:35.414420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca87f64-68d4-4ff3-8b93-961bc811229e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.445583 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1388/2747] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:35.447234 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:35.456416 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd29569-db4b-4186-b819-9fb283c9e261 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.459897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-6bd29569-db4b-4186-b819-9fb283c9e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:35.480290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca87f64-68d4-4ff3-8b93-961bc811229e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.485065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01322e2c-5620-4332-a1b7-3762d9e3b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.485673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01322e2c-5620-4332-a1b7-3762d9e3b0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.485960 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01322e2c-5620-4332-a1b7-3762d9e3b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.486238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01322e2c-5620-4332-a1b7-3762d9e3b0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.486910 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01322e2c-5620-4332-a1b7-3762d9e3b0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.488949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01322e2c-5620-4332-a1b7-3762d9e3b0e9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.515728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd29569-db4b-4186-b819-9fb283c9e261 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.563531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5eed5-0102-4ed5-bbb0-d820b79d779b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.564133 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5eed5-0102-4ed5-bbb0-d820b79d779b service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.564412 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5eed5-0102-4ed5-bbb0-d820b79d779b service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.564685 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5eed5-0102-4ed5-bbb0-d820b79d779b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.586334 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1360/2748] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:35 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:35.590336 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01322e2c-5620-4332-a1b7-3762d9e3b0e9 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.600597 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01322e2c-5620-4332-a1b7-3762d9e3b0e9 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.605361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8596f8-73e3-4e71-bcca-fb9d3d4840aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.606020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8596f8-73e3-4e71-bcca-fb9d3d4840aa admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.606306 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8596f8-73e3-4e71-bcca-fb9d3d4840aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.606630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8596f8-73e3-4e71-bcca-fb9d3d4840aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.607269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8596f8-73e3-4e71-bcca-fb9d3d4840aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.608949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8596f8-73e3-4e71-bcca-fb9d3d4840aa admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.622705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1361/2749] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:05:35.623752 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8596f8-73e3-4e71-bcca-fb9d3d4840aa admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.627239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5eed5-0102-4ed5-bbb0-d820b79d779b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.628706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5eed5-0102-4ed5-bbb0-d820b79d779b service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.633877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8596f8-73e3-4e71-bcca-fb9d3d4840aa admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.638524 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3f641-e475-4c10-8eb6-e4895f5b4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.639112 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f641-e475-4c10-8eb6-e4895f5b4d94 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.639567 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f641-e475-4c10-8eb6-e4895f5b4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.639714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1389/2750] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:35.639818 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3f641-e475-4c10-8eb6-e4895f5b4d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.640321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3f641-e475-4c10-8eb6-e4895f5b4d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.641901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3f641-e475-4c10-8eb6-e4895f5b4d94 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.652974 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1362/2751] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:35.657269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5eed5-0102-4ed5-bbb0-d820b79d779b service cinder] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.668442 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5eed5-0102-4ed5-bbb0-d820b79d779b service cinder] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.673038 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ed752-6049-4eb6-a4fd-293e753db78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.673683 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ed752-6049-4eb6-a4fd-293e753db78c admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.673965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ed752-6049-4eb6-a4fd-293e753db78c admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.674239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ed752-6049-4eb6-a4fd-293e753db78c admin admin] PATH_INFO: `/v3/projects/586873fad254496ba080b51ee7ef1cf3/users/79366b11bddc4d7dba6fa153fad26067/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.692169 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ed752-6049-4eb6-a4fd-293e753db78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=586873fad254496ba080b51ee7ef1cf3, user_id=79366b11bddc4d7dba6fa153fad26067, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.695055 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ed752-6049-4eb6-a4fd-293e753db78c admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.698160 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:35.769221 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1390/2752] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:35 2022] PUT /identity/v3/projects/586873fad254496ba080b51ee7ef1cf3/users/79366b11bddc4d7dba6fa153fad26067/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:35.778250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3f641-e475-4c10-8eb6-e4895f5b4d94 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.780539 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca664f-a1ce-4a44-a726-458369a56d3e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.785104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca664f-a1ce-4a44-a726-458369a56d3e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.785104 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca664f-a1ce-4a44-a726-458369a56d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.789278 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3f641-e475-4c10-8eb6-e4895f5b4d94 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.810850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-9dca664f-a1ce-4a44-a726-458369a56d3e None None] MFA Rules not processed for user `79366b11bddc4d7dba6fa153fad26067`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:35.812357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9dca664f-a1ce-4a44-a726-458369a56d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:35.847827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.848456 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.848737 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.849013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] PATH_INFO: `/v3/users/b66d050be9734edcb0d803c9a3786439` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.850271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66d050be9734edcb0d803c9a3786439)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.852243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.877390 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1391/2753] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:35.890097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca664f-a1ce-4a44-a726-458369a56d3e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:35.945531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca664f-a1ce-4a44-a726-458369a56d3e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.949254 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf436-f326-4091-8582-c6659b3b25a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.949847 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf436-f326-4091-8582-c6659b3b25a1 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.950124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf436-f326-4091-8582-c6659b3b25a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.950399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf436-f326-4091-8582-c6659b3b25a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.958493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf436-f326-4091-8582-c6659b3b25a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.960533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf436-f326-4091-8582-c6659b3b25a1 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.969350 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1392/2754] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:36.085660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66d050be9734edcb0d803c9a3786439'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:36.086398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66d050be9734edcb0d803c9a3786439'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:36.087017 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66d050be9734edcb0d803c9a3786439'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:36.099799 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66d050be9734edcb0d803c9a3786439'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:36.201047 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66d050be9734edcb0d803c9a3786439'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:36.214041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1363/2755] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:35 2022] DELETE /identity/v3/users/b66d050be9734edcb0d803c9a3786439 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:36.218584 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb702d-87b5-4527-9887-5245b0e28d7e None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:36.223613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb702d-87b5-4527-9887-5245b0e28d7e None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:36.223613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb702d-87b5-4527-9887-5245b0e28d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:36.237676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d3cb702d-87b5-4527-9887-5245b0e28d7e None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:36.238854 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d3cb702d-87b5-4527-9887-5245b0e28d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:36.302283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1393/2756] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:36.313160 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:36.314628 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:36.334270 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:36.377211 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8cfb2-719b-4500-88b7-278d43410381 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:36.381085 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8e522-7f7f-4a29-82dd-57e6b61de9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:36.382237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8e522-7f7f-4a29-82dd-57e6b61de9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:36.382517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8e522-7f7f-4a29-82dd-57e6b61de9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:36.382821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8e522-7f7f-4a29-82dd-57e6b61de9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:36.392095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8e522-7f7f-4a29-82dd-57e6b61de9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:36.393547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8e522-7f7f-4a29-82dd-57e6b61de9d9 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:36.403181 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1364/2757] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:36.794122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb702d-87b5-4527-9887-5245b0e28d7e None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:36.795696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d3cb702d-87b5-4527-9887-5245b0e28d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:36.810636 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb702d-87b5-4527-9887-5245b0e28d7e None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:36.816498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:36.817151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:36.817430 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:36.817702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] PATH_INFO: `/v3/projects/59d1cd98ecdf4e83b038cf542cb1d751` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:36.819525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d1cd98ecdf4e83b038cf542cb1d751)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:36.821056 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:36.850794 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:36.997736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d1cd98ecdf4e83b038cf542cb1d751', 'request_id': 'req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.012736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d1cd98ecdf4e83b038cf542cb1d751', 'request_id': 'req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.088389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d1cd98ecdf4e83b038cf542cb1d751', 'request_id': 'req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.108150 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] The token cache is being invalidate because project 59d1cd98ecdf4e83b038cf542cb1d751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:37.108439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.109105 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-b5ea5366-9868-43cb-bf79-bfcaef1b65ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.111664 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1394/2758] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:36 2022] DELETE /identity/v3/projects/59d1cd98ecdf4e83b038cf542cb1d751 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:37.116321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8e522-7f7f-4a29-82dd-57e6b61de9d9 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:37.126450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8e522-7f7f-4a29-82dd-57e6b61de9d9 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:37.195762 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:37.196398 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:37.196683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:37.197072 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] PATH_INFO: `/v3/users/0f62d4270ff44b80b14c9816531a75f1` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:37.198250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f62d4270ff44b80b14c9816531a75f1)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:37.200257 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:37.417263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f62d4270ff44b80b14c9816531a75f1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.418285 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f62d4270ff44b80b14c9816531a75f1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.418553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f62d4270ff44b80b14c9816531a75f1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.433197 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f62d4270ff44b80b14c9816531a75f1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.527027 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f62d4270ff44b80b14c9816531a75f1'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.542630 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1365/2759] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:37 2022] DELETE /identity/v3/users/0f62d4270ff44b80b14c9816531a75f1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:37.622501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707d2e4-90aa-4398-b3c5-7a0738913c21 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:37.622711 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707d2e4-90aa-4398-b3c5-7a0738913c21 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:37.622980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707d2e4-90aa-4398-b3c5-7a0738913c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:37.643069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c707d2e4-90aa-4398-b3c5-7a0738913c21 None None] MFA Rules not processed for user `79366b11bddc4d7dba6fa153fad26067`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:37.644432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c707d2e4-90aa-4398-b3c5-7a0738913c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:37.700508 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1395/2760] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:37.959013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:37.961348 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:38.012465 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:38.033366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95769b71-cf52-4cf4-ae32-962820147ae0 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.038758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.039430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.039716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.040946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] PATH_INFO: `/v3/projects/791f7b74849941dfabe757ce081645a0` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.041185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] RBAC: Authorizing `identity:delete_project(project_id=791f7b74849941dfabe757ce081645a0)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.043099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.184950 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791f7b74849941dfabe757ce081645a0', 'request_id': 'req-0d103860-f0e1-4c92-822f-a4b7319f858c'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:38.304287 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791f7b74849941dfabe757ce081645a0', 'request_id': 'req-0d103860-f0e1-4c92-822f-a4b7319f858c'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:38.310661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791f7b74849941dfabe757ce081645a0', 'request_id': 'req-0d103860-f0e1-4c92-822f-a4b7319f858c'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:38.323155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] The token cache is being invalidate because project 791f7b74849941dfabe757ce081645a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:38.323482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:38.326420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0d103860-f0e1-4c92-822f-a4b7319f858c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:38.326420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1366/2761] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:37 2022] DELETE /identity/v3/projects/791f7b74849941dfabe757ce081645a0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:38.327779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707d2e4-90aa-4398-b3c5-7a0738913c21 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.329297 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c707d2e4-90aa-4398-b3c5-7a0738913c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:38.331769 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34724-722c-47c0-8128-6e82f0ea44f8 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.332059 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34724-722c-47c0-8128-6e82f0ea44f8 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.332390 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff34724-722c-47c0-8128-6e82f0ea44f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.355099 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-cff34724-722c-47c0-8128-6e82f0ea44f8 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:38.360871 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-cff34724-722c-47c0-8128-6e82f0ea44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:38.422313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1367/2762] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:38.424209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707d2e4-90aa-4398-b3c5-7a0738913c21 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.431916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6260-6bbe-4c90-8f9a-4cb557744985 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.432210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6260-6bbe-4c90-8f9a-4cb557744985 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.432489 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6260-6bbe-4c90-8f9a-4cb557744985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.452399 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-3d7b6260-6bbe-4c90-8f9a-4cb557744985 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:38.453583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-3d7b6260-6bbe-4c90-8f9a-4cb557744985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:38.462096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1368/2763] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:38.466142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6260-6bbe-4c90-8f9a-4cb557744985 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.474993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6260-6bbe-4c90-8f9a-4cb557744985 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.479887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73326c-c681-45db-a1a6-65361030e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.480512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73326c-c681-45db-a1a6-65361030e4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.480654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:38.480863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73326c-c681-45db-a1a6-65361030e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.481079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73326c-c681-45db-a1a6-65361030e4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.481725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73326c-c681-45db-a1a6-65361030e4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:38.482034 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73326c-c681-45db-a1a6-65361030e4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.483863 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73326c-c681-45db-a1a6-65361030e4e8 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.488177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a813a-7b47-495a-811d-1d965d5a328d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.488824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a813a-7b47-495a-811d-1d965d5a328d service placement] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.489065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a813a-7b47-495a-811d-1d965d5a328d service placement] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.489339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a813a-7b47-495a-811d-1d965d5a328d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.492156 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ba3a813a-7b47-495a-811d-1d965d5a328d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:38.496479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1369/2764] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:05:38.500743 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73326c-c681-45db-a1a6-65361030e4e8 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.504182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a813a-7b47-495a-811d-1d965d5a328d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.505785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a813a-7b47-495a-811d-1d965d5a328d service placement] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.511915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73326c-c681-45db-a1a6-65361030e4e8 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.516243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298a1a-0ce7-4539-b208-f1ef47df5b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.516709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1396/2765] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:38.516893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298a1a-0ce7-4539-b208-f1ef47df5b0e admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.517179 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298a1a-0ce7-4539-b208-f1ef47df5b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.517554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298a1a-0ce7-4539-b208-f1ef47df5b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.518180 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298a1a-0ce7-4539-b208-f1ef47df5b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.520232 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298a1a-0ce7-4539-b208-f1ef47df5b0e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.608455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1370/2766] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:38 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:38.609682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a813a-7b47-495a-811d-1d965d5a328d service placement] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.620299 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a813a-7b47-495a-811d-1d965d5a328d service placement] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.685125 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2aaf9-94eb-4e8c-9529-47816cfbcd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.685738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2aaf9-94eb-4e8c-9529-47816cfbcd43 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.686113 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2aaf9-94eb-4e8c-9529-47816cfbcd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.686310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2aaf9-94eb-4e8c-9529-47816cfbcd43 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.686872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2aaf9-94eb-4e8c-9529-47816cfbcd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.689073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2aaf9-94eb-4e8c-9529-47816cfbcd43 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.802478 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1397/2767] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:38 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:38.806704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298a1a-0ce7-4539-b208-f1ef47df5b0e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.817666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298a1a-0ce7-4539-b208-f1ef47df5b0e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.823028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc037a-cca0-46a0-8be6-d2c774e50098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.823697 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc037a-cca0-46a0-8be6-d2c774e50098 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.823984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc037a-cca0-46a0-8be6-d2c774e50098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.824259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc037a-cca0-46a0-8be6-d2c774e50098 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.824899 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc037a-cca0-46a0-8be6-d2c774e50098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.826508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc037a-cca0-46a0-8be6-d2c774e50098 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.837523 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1371/2768] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:05:38.842771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2aaf9-94eb-4e8c-9529-47816cfbcd43 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.854097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2aaf9-94eb-4e8c-9529-47816cfbcd43 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.858841 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8c544-b56a-4f47-870e-42a6fa80a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.859468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8c544-b56a-4f47-870e-42a6fa80a42a admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.859754 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8c544-b56a-4f47-870e-42a6fa80a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.860031 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8c544-b56a-4f47-870e-42a6fa80a42a admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.860672 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8c544-b56a-4f47-870e-42a6fa80a42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.862263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8c544-b56a-4f47-870e-42a6fa80a42a admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.876325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1398/2769] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:38.877553 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc037a-cca0-46a0-8be6-d2c774e50098 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.887892 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc037a-cca0-46a0-8be6-d2c774e50098 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.892441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbea7c-ab89-4b8f-8a2a-7c5082c6d84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.893080 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbea7c-ab89-4b8f-8a2a-7c5082c6d84e admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.893363 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbea7c-ab89-4b8f-8a2a-7c5082c6d84e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.893639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbea7c-ab89-4b8f-8a2a-7c5082c6d84e admin admin] PATH_INFO: `/v3/projects/435669a1788b49d0affdaf4b961fcf5f/users/c3110b5d71d140be9b4acf96ac55f002/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.905748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:38.908777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbea7c-ab89-4b8f-8a2a-7c5082c6d84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=435669a1788b49d0affdaf4b961fcf5f, user_id=c3110b5d71d140be9b4acf96ac55f002, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.911476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbea7c-ab89-4b8f-8a2a-7c5082c6d84e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:39.037925 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1372/2770] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:38 2022] PUT /identity/v3/projects/435669a1788b49d0affdaf4b961fcf5f/users/c3110b5d71d140be9b4acf96ac55f002/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:39.048752 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdec82-78fc-4f24-a142-d2d8c668d506 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:39.049042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdec82-78fc-4f24-a142-d2d8c668d506 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:39.049316 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdec82-78fc-4f24-a142-d2d8c668d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:39.082806 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-51fdec82-78fc-4f24-a142-d2d8c668d506 None None] MFA Rules not processed for user `c3110b5d71d140be9b4acf96ac55f002`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:39.084568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-51fdec82-78fc-4f24-a142-d2d8c668d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:39.151207 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1399/2771] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:39.163462 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbea7c-ab89-4b8f-8a2a-7c5082c6d84e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:39.165314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c4bbea7c-ab89-4b8f-8a2a-7c5082c6d84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:39.221709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbea7c-ab89-4b8f-8a2a-7c5082c6d84e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:39.226084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486a9e3-419b-4224-b29b-ddc9afd7a7c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:39.226693 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a9e3-419b-4224-b29b-ddc9afd7a7c7 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:39.227359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a9e3-419b-4224-b29b-ddc9afd7a7c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:39.227359 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a9e3-419b-4224-b29b-ddc9afd7a7c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:39.235840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486a9e3-419b-4224-b29b-ddc9afd7a7c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:39.237273 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486a9e3-419b-4224-b29b-ddc9afd7a7c7 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:39.246346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1373/2772] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:39.269296 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdec82-78fc-4f24-a142-d2d8c668d506 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:39.345901 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:39.350787 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdec82-78fc-4f24-a142-d2d8c668d506 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:39.355420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:39.356112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:39.356570 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:39.356853 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] PATH_INFO: `/v3/users/c3110b5d71d140be9b4acf96ac55f002` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:39.358003 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3110b5d71d140be9b4acf96ac55f002)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:39.360575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:39.540479 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3110b5d71d140be9b4acf96ac55f002'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:39.541137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3110b5d71d140be9b4acf96ac55f002'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:39.541743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3110b5d71d140be9b4acf96ac55f002'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:39.601069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3110b5d71d140be9b4acf96ac55f002'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:39.613639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3110b5d71d140be9b4acf96ac55f002'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:39.625920 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1400/2773] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:39 2022] DELETE /identity/v3/users/c3110b5d71d140be9b4acf96ac55f002 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:39.630517 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a638a-3f20-48a1-940c-09e776b9ff91 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:39.632429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a638a-3f20-48a1-940c-09e776b9ff91 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:39.632429 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a638a-3f20-48a1-940c-09e776b9ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:39.652094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-870a638a-3f20-48a1-940c-09e776b9ff91 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:39.653290 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-870a638a-3f20-48a1-940c-09e776b9ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:39.712410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1374/2774] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:39.722174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:39.723601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:39.781027 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d10aa-6157-4d3e-8de2-419e1d62c5cb admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:39.784772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba748d9b-a40f-499e-bfd1-8f6774bfa759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:39.785372 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba748d9b-a40f-499e-bfd1-8f6774bfa759 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:39.785666 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba748d9b-a40f-499e-bfd1-8f6774bfa759 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:39.785949 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba748d9b-a40f-499e-bfd1-8f6774bfa759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:39.795136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba748d9b-a40f-499e-bfd1-8f6774bfa759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:39.796602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba748d9b-a40f-499e-bfd1-8f6774bfa759 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:39.807399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1401/2775] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:40.209084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a638a-3f20-48a1-940c-09e776b9ff91 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:40.211173 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-870a638a-3f20-48a1-940c-09e776b9ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:40.229086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a638a-3f20-48a1-940c-09e776b9ff91 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:40.237573 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:40.239982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:40.239982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:40.239982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] PATH_INFO: `/v3/projects/435669a1788b49d0affdaf4b961fcf5f` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:40.242142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435669a1788b49d0affdaf4b961fcf5f)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:40.244825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:40.386003 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435669a1788b49d0affdaf4b961fcf5f', 'request_id': 'req-03db17a7-0f53-48c8-b023-eb5d2d5e1066'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:40.471024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435669a1788b49d0affdaf4b961fcf5f', 'request_id': 'req-03db17a7-0f53-48c8-b023-eb5d2d5e1066'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:40.479196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435669a1788b49d0affdaf4b961fcf5f', 'request_id': 'req-03db17a7-0f53-48c8-b023-eb5d2d5e1066'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:40.492060 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] The token cache is being invalidate because project 435669a1788b49d0affdaf4b961fcf5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:40.492327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:40.493096 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-03db17a7-0f53-48c8-b023-eb5d2d5e1066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:40.494798 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1375/2776] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:40 2022] DELETE /identity/v3/projects/435669a1788b49d0affdaf4b961fcf5f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:40.499494 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d7cc-b796-4fe4-9605-d7deb3f0980f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:40.499965 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d7cc-b796-4fe4-9605-d7deb3f0980f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:40.500064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d7cc-b796-4fe4-9605-d7deb3f0980f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:40.522292 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-8737d7cc-b796-4fe4-9605-d7deb3f0980f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:40.523534 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-8737d7cc-b796-4fe4-9605-d7deb3f0980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:40.597961 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1402/2777] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:40.606493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a6549-3371-49ee-a083-841dc5ee620d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:40.606780 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a6549-3371-49ee-a083-841dc5ee620d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:40.607064 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a6549-3371-49ee-a083-841dc5ee620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:40.627431 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c62a6549-3371-49ee-a083-841dc5ee620d None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:40.628563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c62a6549-3371-49ee-a083-841dc5ee620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:40.637113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1376/2778] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:40.641523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737d7cc-b796-4fe4-9605-d7deb3f0980f None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:40.651789 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737d7cc-b796-4fe4-9605-d7deb3f0980f None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:40.656338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fb529-1abe-4861-9d80-cfa1c61bcae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:40.656930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fb529-1abe-4861-9d80-cfa1c61bcae0 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:40.657215 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fb529-1abe-4861-9d80-cfa1c61bcae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:40.657486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fb529-1abe-4861-9d80-cfa1c61bcae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:40.658123 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fb529-1abe-4861-9d80-cfa1c61bcae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:40.658425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fb529-1abe-4861-9d80-cfa1c61bcae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:40.660043 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fb529-1abe-4861-9d80-cfa1c61bcae0 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:40.671540 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1403/2779] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:05:40.675859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a6549-3371-49ee-a083-841dc5ee620d None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:40.685687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a6549-3371-49ee-a083-841dc5ee620d None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:40.690559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd335e-b13f-4a2d-b560-ee12ce087138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:40.691149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd335e-b13f-4a2d-b560-ee12ce087138 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:40.691599 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd335e-b13f-4a2d-b560-ee12ce087138 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:40.691721 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd335e-b13f-4a2d-b560-ee12ce087138 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:40.692345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd335e-b13f-4a2d-b560-ee12ce087138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:40.694901 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd335e-b13f-4a2d-b560-ee12ce087138 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:40.704271 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:40.814289 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1377/2780] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:40 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:40.815864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fb529-1abe-4861-9d80-cfa1c61bcae0 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:40.826761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fb529-1abe-4861-9d80-cfa1c61bcae0 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:40.830353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:40.886592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063f4f-6264-42e3-945b-a74627dda9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:40.886592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063f4f-6264-42e3-945b-a74627dda9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:40.886592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063f4f-6264-42e3-945b-a74627dda9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:40.886592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063f4f-6264-42e3-945b-a74627dda9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:40.887174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3063f4f-6264-42e3-945b-a74627dda9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:40.887174 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3063f4f-6264-42e3-945b-a74627dda9b9 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:40.992614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1404/2781] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:40 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:40.996294 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd335e-b13f-4a2d-b560-ee12ce087138 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:41.006992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd335e-b13f-4a2d-b560-ee12ce087138 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:41.011777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76600ba4-d37d-4989-bde0-9b6334487386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:41.012425 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600ba4-d37d-4989-bde0-9b6334487386 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:41.012677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600ba4-d37d-4989-bde0-9b6334487386 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:41.013148 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600ba4-d37d-4989-bde0-9b6334487386 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:41.013975 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76600ba4-d37d-4989-bde0-9b6334487386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:41.016116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76600ba4-d37d-4989-bde0-9b6334487386 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:41.026155 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1378/2782] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:41.030167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063f4f-6264-42e3-945b-a74627dda9b9 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:41.040981 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063f4f-6264-42e3-945b-a74627dda9b9 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:41.045649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00fcf2-727b-430a-96b7-60b4e0e0d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:41.046240 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00fcf2-727b-430a-96b7-60b4e0e0d015 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:41.046530 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00fcf2-727b-430a-96b7-60b4e0e0d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:41.046814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00fcf2-727b-430a-96b7-60b4e0e0d015 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:41.047483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00fcf2-727b-430a-96b7-60b4e0e0d015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:41.049073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00fcf2-727b-430a-96b7-60b4e0e0d015 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:41.064351 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1405/2783] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:41.068652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76600ba4-d37d-4989-bde0-9b6334487386 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:41.079124 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76600ba4-d37d-4989-bde0-9b6334487386 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:41.083868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffdc1d-5c07-41f1-b88f-85bb8c2020aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:41.084562 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffdc1d-5c07-41f1-b88f-85bb8c2020aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:41.084837 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffdc1d-5c07-41f1-b88f-85bb8c2020aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:41.085102 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffdc1d-5c07-41f1-b88f-85bb8c2020aa admin admin] PATH_INFO: `/v3/projects/383d97b341b944da812d7e37a5b0254c/users/3001d58d1e1444b5bd0801e0b262fd5a/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:41.101218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffdc1d-5c07-41f1-b88f-85bb8c2020aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=383d97b341b944da812d7e37a5b0254c, user_id=3001d58d1e1444b5bd0801e0b262fd5a, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:41.104041 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffdc1d-5c07-41f1-b88f-85bb8c2020aa admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:41.179699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1379/2784] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:41 2022] PUT /identity/v3/projects/383d97b341b944da812d7e37a5b0254c/users/3001d58d1e1444b5bd0801e0b262fd5a/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:41.191998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6709c4-9acd-45e0-9f10-26c8a3e9890b None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:41.192649 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6709c4-9acd-45e0-9f10-26c8a3e9890b None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:41.192991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6709c4-9acd-45e0-9f10-26c8a3e9890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:41.222291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-0d6709c4-9acd-45e0-9f10-26c8a3e9890b None None] MFA Rules not processed for user `3001d58d1e1444b5bd0801e0b262fd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:41.223954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0d6709c4-9acd-45e0-9f10-26c8a3e9890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:41.290679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1406/2785] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:41.302283 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffdc1d-5c07-41f1-b88f-85bb8c2020aa admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:41.304356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-afffdc1d-5c07-41f1-b88f-85bb8c2020aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:41.368709 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffdc1d-5c07-41f1-b88f-85bb8c2020aa admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:41.374583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff53e-6381-4634-a7ef-5ff0c421e25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:41.376149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff53e-6381-4634-a7ef-5ff0c421e25e service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:41.376149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff53e-6381-4634-a7ef-5ff0c421e25e service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:41.376149 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff53e-6381-4634-a7ef-5ff0c421e25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:41.386919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff53e-6381-4634-a7ef-5ff0c421e25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:41.389111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff53e-6381-4634-a7ef-5ff0c421e25e service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:41.398196 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1380/2786] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:42.639913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6709c4-9acd-45e0-9f10-26c8a3e9890b None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:42.641378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0d6709c4-9acd-45e0-9f10-26c8a3e9890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:42.703829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6709c4-9acd-45e0-9f10-26c8a3e9890b None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:42.708450 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:42.709852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:42.710236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:42.710616 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:42.713232 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:42.725543 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:42.727209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:42.736512 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1407/2787] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:43.567677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff53e-6381-4634-a7ef-5ff0c421e25e service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:43.569943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4b0ff53e-6381-4634-a7ef-5ff0c421e25e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:43.658004 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff53e-6381-4634-a7ef-5ff0c421e25e service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:43.664246 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331f000-ef30-42eb-a611-a0176f9fb11e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:43.664920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331f000-ef30-42eb-a611-a0176f9fb11e service nova] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:43.665203 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331f000-ef30-42eb-a611-a0176f9fb11e service nova] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:43.665476 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331f000-ef30-42eb-a611-a0176f9fb11e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:43.667312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1331f000-ef30-42eb-a611-a0176f9fb11e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:43.681086 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331f000-ef30-42eb-a611-a0176f9fb11e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:43.682735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331f000-ef30-42eb-a611-a0176f9fb11e service nova] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:43.695024 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1381/2788] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:50.576222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:50.577699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:50.594614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a815d76-971e-420f-bd16-51bc48240f94 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:50.600077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:50.605206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:50.605206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:50.605206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:50.605206 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:50.616220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:50.617844 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:50.628265 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1408/2789] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:53.689395 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:57.669496 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07893382-d05c-4e71-a4b3-3906864dd30d None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:57.677043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07893382-d05c-4e71-a4b3-3906864dd30d None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:57.677043 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07893382-d05c-4e71-a4b3-3906864dd30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:57.721594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-07893382-d05c-4e71-a4b3-3906864dd30d None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:57.722833 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-07893382-d05c-4e71-a4b3-3906864dd30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:57.788543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1382/2790] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 08:05:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:57.930650 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:57.932759 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:57.937786 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:58.026979 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b120d-5a63-4a26-bc28-04301cd6e9b1 service nova] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:58.032078 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b475-e491-4e74-9e23-dfc91da5d845 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:58.032676 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b475-e491-4e74-9e23-dfc91da5d845 service swift] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:58.032956 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b475-e491-4e74-9e23-dfc91da5d845 service swift] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:58.033229 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b475-e491-4e74-9e23-dfc91da5d845 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:58.041743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2b475-e491-4e74-9e23-dfc91da5d845 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:58.043381 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2b475-e491-4e74-9e23-dfc91da5d845 service swift] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:58.051592 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1409/2791] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 08:05:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:05:58.942194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109fdc-511a-4d07-b270-553460657b13 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:58.942656 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109fdc-511a-4d07-b270-553460657b13 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:58.942759 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109fdc-511a-4d07-b270-553460657b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:58.961402 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-b3109fdc-511a-4d07-b270-553460657b13 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:58.962706 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b3109fdc-511a-4d07-b270-553460657b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:58.969774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1383/2792] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 08:05:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:58.982296 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b475-e491-4e74-9e23-dfc91da5d845 service swift] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:58.993095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b475-e491-4e74-9e23-dfc91da5d845 service swift] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:58.998723 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a4b13-08dc-42e3-92ac-8aa1b64a3dd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:58.999339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a4b13-08dc-42e3-92ac-8aa1b64a3dd1 service swift] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:58.999632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a4b13-08dc-42e3-92ac-8aa1b64a3dd1 service swift] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:58.999892 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a4b13-08dc-42e3-92ac-8aa1b64a3dd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:59.007974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a4b13-08dc-42e3-92ac-8aa1b64a3dd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:59.009838 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a4b13-08dc-42e3-92ac-8aa1b64a3dd1 service swift] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:59.017952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1410/2793] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 08:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:05:59.341212 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109fdc-511a-4d07-b270-553460657b13 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:59.412006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109fdc-511a-4d07-b270-553460657b13 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:59.417505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:59.418183 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:59.418467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:59.418742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] PATH_INFO: `/v3/users/3001d58d1e1444b5bd0801e0b262fd5a` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:59.419909 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3001d58d1e1444b5bd0801e0b262fd5a)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:59.421838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:59.593346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3001d58d1e1444b5bd0801e0b262fd5a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:59.593924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3001d58d1e1444b5bd0801e0b262fd5a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:59.594539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3001d58d1e1444b5bd0801e0b262fd5a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:59.606274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3001d58d1e1444b5bd0801e0b262fd5a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:59.608835 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:59.629577 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c964c0-f4c3-4d34-b881-21ba8b8c43f4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:59.629867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c964c0-f4c3-4d34-b881-21ba8b8c43f4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:59.630143 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c964c0-f4c3-4d34-b881-21ba8b8c43f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:59.650730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-c3c964c0-f4c3-4d34-b881-21ba8b8c43f4 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:59.652897 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c3c964c0-f4c3-4d34-b881-21ba8b8c43f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:59.661546 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1411/2794] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 24 08:05:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:59.675145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c964c0-f4c3-4d34-b881-21ba8b8c43f4 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:59.676548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-c3c964c0-f4c3-4d34-b881-21ba8b8c43f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:59.692503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c964c0-f4c3-4d34-b881-21ba8b8c43f4 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:59.698140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a40b8-9b38-4ab9-89c8-d24a5433998e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:59.698741 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a40b8-9b38-4ab9-89c8-d24a5433998e service swift] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:59.699024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a40b8-9b38-4ab9-89c8-d24a5433998e service swift] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:59.699320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a40b8-9b38-4ab9-89c8-d24a5433998e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:59.705063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3001d58d1e1444b5bd0801e0b262fd5a'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:59.707686 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a40b8-9b38-4ab9-89c8-d24a5433998e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:59.709310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a40b8-9b38-4ab9-89c8-d24a5433998e service swift] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:59.717469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1412/2795] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 08:05:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:05:59.718108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1384/2796] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:59 2022] DELETE /identity/v3/users/3001d58d1e1444b5bd0801e0b262fd5a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:59.722929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cff3e-9449-47fa-9de9-32f4e1aef8dd None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:59.723359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cff3e-9449-47fa-9de9-32f4e1aef8dd None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:59.723740 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cff3e-9449-47fa-9de9-32f4e1aef8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:59.743497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-3c6cff3e-9449-47fa-9de9-32f4e1aef8dd None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:59.745553 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3c6cff3e-9449-47fa-9de9-32f4e1aef8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:59.803073 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1413/2797] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:59.813915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:59.815345 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:59.878874 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f24dd-16da-4060-b7fe-dc65a9759911 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:59.882588 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d4993-4dd7-464d-9fb9-dc1c7427ebd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:59.883194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d4993-4dd7-464d-9fb9-dc1c7427ebd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:59.883499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d4993-4dd7-464d-9fb9-dc1c7427ebd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:59.883777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d4993-4dd7-464d-9fb9-dc1c7427ebd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:59.893479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d4993-4dd7-464d-9fb9-dc1c7427ebd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:59.895074 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d4993-4dd7-464d-9fb9-dc1c7427ebd0 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:59.904893 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1385/2798] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:00.323193 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cff3e-9449-47fa-9de9-32f4e1aef8dd None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:00.325360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3c6cff3e-9449-47fa-9de9-32f4e1aef8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:00.350020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9190-addc-4721-98af-7099cb369235 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:00.350527 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cff3e-9449-47fa-9de9-32f4e1aef8dd None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:00.350640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9190-addc-4721-98af-7099cb369235 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:00.350640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9190-addc-4721-98af-7099cb369235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:00.359655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:00.361280 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:00.361808 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:00.362050 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] PATH_INFO: `/v3/projects/383d97b341b944da812d7e37a5b0254c` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:00.363426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] RBAC: Authorizing `identity:delete_project(project_id=383d97b341b944da812d7e37a5b0254c)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:00.365785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:00.373407 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-beab9190-addc-4721-98af-7099cb369235 None None] MFA Rules not processed for user `79129c52456e4455bce3179d1e056fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:00.374583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-beab9190-addc-4721-98af-7099cb369235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:00.432537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1386/2799] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 24 08:06:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:00.444957 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab9190-addc-4721-98af-7099cb369235 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:00.469601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:00.478945 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383d97b341b944da812d7e37a5b0254c', 'request_id': 'req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:00.486391 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383d97b341b944da812d7e37a5b0254c', 'request_id': 'req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:00.513186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab9190-addc-4721-98af-7099cb369235 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:00.545276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383d97b341b944da812d7e37a5b0254c', 'request_id': 'req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:00.546764 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:00.561180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] The token cache is being invalidate because project 383d97b341b944da812d7e37a5b0254c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:00.561533 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:00.562423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-63c9b4d7-9b1c-48c1-98fc-d42ac97f532f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:00.563994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1414/2800] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:00 2022] DELETE /identity/v3/projects/383d97b341b944da812d7e37a5b0254c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:00.568849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1690eb-a246-4dbf-aa56-8f297573fafc None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:00.569168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1690eb-a246-4dbf-aa56-8f297573fafc None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:00.569501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1690eb-a246-4dbf-aa56-8f297573fafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:00.582129 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89753e-3519-4f55-9bb9-752f991b0b45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9847a3a5048efb19e507f988e37f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:00.584578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89753e-3519-4f55-9bb9-752f991b0b45 service swift] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:00.584578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89753e-3519-4f55-9bb9-752f991b0b45 service swift] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:00.584578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89753e-3519-4f55-9bb9-752f991b0b45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:00.585967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-6f89753e-3519-4f55-9bb9-752f991b0b45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:00.589593 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-be1690eb-a246-4dbf-aa56-8f297573fafc None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:00.590780 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-be1690eb-a246-4dbf-aa56-8f297573fafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:00.646763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89753e-3519-4f55-9bb9-752f991b0b45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:00.648695 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89753e-3519-4f55-9bb9-752f991b0b45 service swift] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:00.652476 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1415/2801] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:00.657652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1387/2802] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 24 08:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:06:00.660638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c22eb-80b5-4418-b54a-d4b3831aec58 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:00.660638 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c22eb-80b5-4418-b54a-d4b3831aec58 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:00.661028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c22eb-80b5-4418-b54a-d4b3831aec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:00.681637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-213c22eb-80b5-4418-b54a-d4b3831aec58 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:00.683145 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-213c22eb-80b5-4418-b54a-d4b3831aec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:00.691481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1416/2803] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:00.695691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89753e-3519-4f55-9bb9-752f991b0b45 service swift] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:00.706161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89753e-3519-4f55-9bb9-752f991b0b45 service swift] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:00.710831 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb8f1f-9844-4666-b641-b2ed145e22ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:00.711449 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8f1f-9844-4666-b641-b2ed145e22ab admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:00.711729 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8f1f-9844-4666-b641-b2ed145e22ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:00.712001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8f1f-9844-4666-b641-b2ed145e22ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:00.713201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb8f1f-9844-4666-b641-b2ed145e22ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:06:00.713505 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb8f1f-9844-4666-b641-b2ed145e22ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:00.715442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb8f1f-9844-4666-b641-b2ed145e22ab admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:00.726919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1388/2804] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:06:00.731869 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c22eb-80b5-4418-b54a-d4b3831aec58 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:00.741425 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c22eb-80b5-4418-b54a-d4b3831aec58 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:00.746613 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b14e90-4b60-4a54-a5ff-9e4393860c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:00.747230 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b14e90-4b60-4a54-a5ff-9e4393860c36 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:00.747872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b14e90-4b60-4a54-a5ff-9e4393860c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:00.747872 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b14e90-4b60-4a54-a5ff-9e4393860c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:00.748762 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b14e90-4b60-4a54-a5ff-9e4393860c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:00.750644 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b14e90-4b60-4a54-a5ff-9e4393860c36 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:00.843594 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1417/2805] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:00 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:00.847683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb8f1f-9844-4666-b641-b2ed145e22ab admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:00.858313 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb8f1f-9844-4666-b641-b2ed145e22ab admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:00.919427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92029ca-b7fe-435b-8429-b3dfbdf6ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:00.919990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92029ca-b7fe-435b-8429-b3dfbdf6ac51 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:00.920339 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92029ca-b7fe-435b-8429-b3dfbdf6ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:00.920575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92029ca-b7fe-435b-8429-b3dfbdf6ac51 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:00.921201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92029ca-b7fe-435b-8429-b3dfbdf6ac51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:00.923151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92029ca-b7fe-435b-8429-b3dfbdf6ac51 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:00.991484 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1389/2806] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:00 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:01.000782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b14e90-4b60-4a54-a5ff-9e4393860c36 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:01.012388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b14e90-4b60-4a54-a5ff-9e4393860c36 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:01.017437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb393aa-c774-466a-bc6c-0154f7bbce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:01.020795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb393aa-c774-466a-bc6c-0154f7bbce56 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:01.020795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb393aa-c774-466a-bc6c-0154f7bbce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:01.020795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb393aa-c774-466a-bc6c-0154f7bbce56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:01.020795 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb393aa-c774-466a-bc6c-0154f7bbce56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:01.021298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb393aa-c774-466a-bc6c-0154f7bbce56 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:01.035480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1418/2807] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:01.036881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92029ca-b7fe-435b-8429-b3dfbdf6ac51 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:01.047793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92029ca-b7fe-435b-8429-b3dfbdf6ac51 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:01.052649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25bfae-78db-473d-9e06-510eadf0a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:01.053188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25bfae-78db-473d-9e06-510eadf0a0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:01.053467 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25bfae-78db-473d-9e06-510eadf0a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:01.053768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25bfae-78db-473d-9e06-510eadf0a0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:01.054410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25bfae-78db-473d-9e06-510eadf0a0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:01.056878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25bfae-78db-473d-9e06-510eadf0a0f2 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:01.069296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1390/2808] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:01.073929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb393aa-c774-466a-bc6c-0154f7bbce56 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:01.084000 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb393aa-c774-466a-bc6c-0154f7bbce56 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:01.088639 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a48222-b4a5-40fb-8e32-6e7aac03fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:01.089335 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a48222-b4a5-40fb-8e32-6e7aac03fd4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:01.090024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a48222-b4a5-40fb-8e32-6e7aac03fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:01.090024 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a48222-b4a5-40fb-8e32-6e7aac03fd4c admin admin] PATH_INFO: `/v3/projects/bbfa0f0c4122467ab9df792715bbead8/users/35186b6c3fce4f088708d600d9d4a1a0/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:01.107110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a48222-b4a5-40fb-8e32-6e7aac03fd4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfa0f0c4122467ab9df792715bbead8, user_id=35186b6c3fce4f088708d600d9d4a1a0, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:01.109915 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a48222-b4a5-40fb-8e32-6e7aac03fd4c admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:01.193375 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1419/2809] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:01 2022] PUT /identity/v3/projects/bbfa0f0c4122467ab9df792715bbead8/users/35186b6c3fce4f088708d600d9d4a1a0/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:01.209638 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d38e-3fd1-43ed-b1ae-49eb1c0dd973 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:01.210061 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d38e-3fd1-43ed-b1ae-49eb1c0dd973 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:01.210455 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d38e-3fd1-43ed-b1ae-49eb1c0dd973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:01.239903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c1d9d38e-3fd1-43ed-b1ae-49eb1c0dd973 None None] MFA Rules not processed for user `35186b6c3fce4f088708d600d9d4a1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:01.241162 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c1d9d38e-3fd1-43ed-b1ae-49eb1c0dd973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:01.277993 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:01.313058 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1391/2810] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:01.325440 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a48222-b4a5-40fb-8e32-6e7aac03fd4c admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:01.327241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-07a48222-b4a5-40fb-8e32-6e7aac03fd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:01.392690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a48222-b4a5-40fb-8e32-6e7aac03fd4c admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:01.396973 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa86d91-ce98-4f76-92d3-42f408f142bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:01.397580 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa86d91-ce98-4f76-92d3-42f408f142bd service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:01.397864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa86d91-ce98-4f76-92d3-42f408f142bd service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:01.398141 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa86d91-ce98-4f76-92d3-42f408f142bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:01.407984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa86d91-ce98-4f76-92d3-42f408f142bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:01.409434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa86d91-ce98-4f76-92d3-42f408f142bd service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:01.419498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1420/2811] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:03.266747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d38e-3fd1-43ed-b1ae-49eb1c0dd973 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:03.267805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c1d9d38e-3fd1-43ed-b1ae-49eb1c0dd973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:03.335660 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d38e-3fd1-43ed-b1ae-49eb1c0dd973 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:03.340259 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:03.340900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:03.341184 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:03.341461 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] PATH_INFO: `/v3/users/79366b11bddc4d7dba6fa153fad26067` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:03.342587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=79366b11bddc4d7dba6fa153fad26067)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:03.344536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:03.615310 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79366b11bddc4d7dba6fa153fad26067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:03.615905 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79366b11bddc4d7dba6fa153fad26067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:03.616512 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79366b11bddc4d7dba6fa153fad26067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:03.629047 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79366b11bddc4d7dba6fa153fad26067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:03.710324 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79366b11bddc4d7dba6fa153fad26067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:03.724296 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1392/2812] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:03 2022] DELETE /identity/v3/users/79366b11bddc4d7dba6fa153fad26067 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:03.729873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054b454-f738-4add-aa92-c484bc61b157 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:03.730361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054b454-f738-4add-aa92-c484bc61b157 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:03.730475 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054b454-f738-4add-aa92-c484bc61b157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:03.738447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:03.750164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-5054b454-f738-4add-aa92-c484bc61b157 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:03.751451 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5054b454-f738-4add-aa92-c484bc61b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:03.810137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1421/2813] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:03.820209 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:03.821838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:03.881931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ec2cd-ae30-48a8-b6aa-883cf379a7de admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:03.887426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c77be0-04da-4972-8dbb-446daa6a19d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:03.887426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c77be0-04da-4972-8dbb-446daa6a19d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:03.887426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c77be0-04da-4972-8dbb-446daa6a19d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:03.887426 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c77be0-04da-4972-8dbb-446daa6a19d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:03.892683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:03.896312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c77be0-04da-4972-8dbb-446daa6a19d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:03.897747 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c77be0-04da-4972-8dbb-446daa6a19d4 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:03.907999 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1393/2814] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:04.134976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054b454-f738-4add-aa92-c484bc61b157 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.136579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-5054b454-f738-4add-aa92-c484bc61b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.149116 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054b454-f738-4add-aa92-c484bc61b157 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.154356 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.155026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.155337 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.155647 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] PATH_INFO: `/v3/projects/586873fad254496ba080b51ee7ef1cf3` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.156782 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586873fad254496ba080b51ee7ef1cf3)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.158706 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.269368 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586873fad254496ba080b51ee7ef1cf3', 'request_id': 'req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.275849 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586873fad254496ba080b51ee7ef1cf3', 'request_id': 'req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.373590 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586873fad254496ba080b51ee7ef1cf3', 'request_id': 'req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.384801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] The token cache is being invalidate because project 586873fad254496ba080b51ee7ef1cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:04.385021 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.385651 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.387148 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1422/2815] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:04 2022] DELETE /identity/v3/projects/586873fad254496ba080b51ee7ef1cf3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:04.392157 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65edb1-3d0f-42f6-9774-b8f9e6acf930 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.392616 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65edb1-3d0f-42f6-9774-b8f9e6acf930 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.392717 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65edb1-3d0f-42f6-9774-b8f9e6acf930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.412570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-8f65edb1-3d0f-42f6-9774-b8f9e6acf930 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:04.413770 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-8f65edb1-3d0f-42f6-9774-b8f9e6acf930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.437566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.438989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.480239 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1394/2816] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:04.488159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe1de-86f3-41d7-8678-7dfdffdcbf29 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.488480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe1de-86f3-41d7-8678-7dfdffdcbf29 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.488763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fe1de-86f3-41d7-8678-7dfdffdcbf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.508188 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-ca2fe1de-86f3-41d7-8678-7dfdffdcbf29 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:04.509430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-ca2fe1de-86f3-41d7-8678-7dfdffdcbf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.510201 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124c6c-e2e3-465c-8566-1dc5dcf22cd2 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.514820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.515483 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.515769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.516047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] PATH_INFO: `/v3/users/35186b6c3fce4f088708d600d9d4a1a0` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.517182 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] RBAC: Authorizing `identity:delete_user(user_id=35186b6c3fce4f088708d600d9d4a1a0)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.517447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1395/2817] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:04.521115 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.521566 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fe1de-86f3-41d7-8678-7dfdffdcbf29 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.531204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fe1de-86f3-41d7-8678-7dfdffdcbf29 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.536077 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce187d5a-c422-4da7-9541-a17fdb3a0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.536766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce187d5a-c422-4da7-9541-a17fdb3a0232 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.537145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce187d5a-c422-4da7-9541-a17fdb3a0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.537515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce187d5a-c422-4da7-9541-a17fdb3a0232 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.538256 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce187d5a-c422-4da7-9541-a17fdb3a0232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:06:04.538658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce187d5a-c422-4da7-9541-a17fdb3a0232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.540280 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce187d5a-c422-4da7-9541-a17fdb3a0232 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.552676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1396/2818] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:06:04.556840 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce187d5a-c422-4da7-9541-a17fdb3a0232 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.566699 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce187d5a-c422-4da7-9541-a17fdb3a0232 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.571466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ef5be-ece3-4f34-a792-648db7d6b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.572353 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef5be-ece3-4f34-a792-648db7d6b39c admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.572645 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef5be-ece3-4f34-a792-648db7d6b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.572922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ef5be-ece3-4f34-a792-648db7d6b39c admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.573539 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ef5be-ece3-4f34-a792-648db7d6b39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.575445 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ef5be-ece3-4f34-a792-648db7d6b39c admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.637244 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1397/2819] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:04 2022] POST /identity/v3/projects => generated 391 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:04.641333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ef5be-ece3-4f34-a792-648db7d6b39c admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.687245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:04.701033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35186b6c3fce4f088708d600d9d4a1a0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.701785 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35186b6c3fce4f088708d600d9d4a1a0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.702432 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35186b6c3fce4f088708d600d9d4a1a0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.704356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ef5be-ece3-4f34-a792-648db7d6b39c admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.709078 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12f00-c765-4d0c-935d-5a2639d995a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.709679 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12f00-c765-4d0c-935d-5a2639d995a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.709961 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12f00-c765-4d0c-935d-5a2639d995a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.710236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12f00-c765-4d0c-935d-5a2639d995a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.710890 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f12f00-c765-4d0c-935d-5a2639d995a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.714052 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f12f00-c765-4d0c-935d-5a2639d995a6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.772101 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35186b6c3fce4f088708d600d9d4a1a0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.785130 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-c875ea00-5d5e-4c01-a888-9abf0cad582d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35186b6c3fce4f088708d600d9d4a1a0'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:04.797998 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1423/2820] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:04 2022] DELETE /identity/v3/users/35186b6c3fce4f088708d600d9d4a1a0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:04.802388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3e45d-061d-4d4b-af6e-6919826440ca None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.802678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3e45d-061d-4d4b-af6e-6919826440ca None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.802958 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3e45d-061d-4d4b-af6e-6919826440ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.807001 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1398/2821] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:04 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:06:04.815067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12f00-c765-4d0c-935d-5a2639d995a6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.816943 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c6f12f00-c765-4d0c-935d-5a2639d995a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.824223 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-31e3e45d-061d-4d4b-af6e-6919826440ca None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:04.825406 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-31e3e45d-061d-4d4b-af6e-6919826440ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.829894 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12f00-c765-4d0c-935d-5a2639d995a6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.870820 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:04.888384 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd141f-082e-45b2-ab18-65472ad8b571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.888548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1424/2822] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:04.888962 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd141f-082e-45b2-ab18-65472ad8b571 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.889214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd141f-082e-45b2-ab18-65472ad8b571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.889486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd141f-082e-45b2-ab18-65472ad8b571 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.890125 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd141f-082e-45b2-ab18-65472ad8b571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.892268 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd141f-082e-45b2-ab18-65472ad8b571 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.898069 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3e45d-061d-4d4b-af6e-6919826440ca None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.899521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-31e3e45d-061d-4d4b-af6e-6919826440ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.903141 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1399/2823] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:04.906649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd141f-082e-45b2-ab18-65472ad8b571 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.917250 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd141f-082e-45b2-ab18-65472ad8b571 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.922592 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22d076-d759-4e19-b5ab-787c55fcaff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.923185 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22d076-d759-4e19-b5ab-787c55fcaff7 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.923504 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22d076-d759-4e19-b5ab-787c55fcaff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.923778 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22d076-d759-4e19-b5ab-787c55fcaff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.924441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22d076-d759-4e19-b5ab-787c55fcaff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.926046 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22d076-d759-4e19-b5ab-787c55fcaff7 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.937163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1400/2824] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:06:04.941292 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22d076-d759-4e19-b5ab-787c55fcaff7 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.952103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22d076-d759-4e19-b5ab-787c55fcaff7 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.956850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a75ef-fbb0-46ed-89eb-0c2ee438af4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.957492 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a75ef-fbb0-46ed-89eb-0c2ee438af4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.957777 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a75ef-fbb0-46ed-89eb-0c2ee438af4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.958053 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a75ef-fbb0-46ed-89eb-0c2ee438af4f admin admin] PATH_INFO: `/v3/projects/d663fdd08553462f94542fbf56319434/users/5490b98432144f7983e69e2200b35306/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.963836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3e45d-061d-4d4b-af6e-6919826440ca None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.967610 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53915b4-ea94-4bf7-b7dc-b4f1a9f42961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.968334 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53915b4-ea94-4bf7-b7dc-b4f1a9f42961 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.969321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53915b4-ea94-4bf7-b7dc-b4f1a9f42961 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.969321 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53915b4-ea94-4bf7-b7dc-b4f1a9f42961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.974309 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a75ef-fbb0-46ed-89eb-0c2ee438af4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d663fdd08553462f94542fbf56319434, user_id=5490b98432144f7983e69e2200b35306, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.977063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a75ef-fbb0-46ed-89eb-0c2ee438af4f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.978878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53915b4-ea94-4bf7-b7dc-b4f1a9f42961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.980354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53915b4-ea94-4bf7-b7dc-b4f1a9f42961 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.989864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1425/2825] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:05.049088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1401/2826] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:04 2022] PUT /identity/v3/projects/d663fdd08553462f94542fbf56319434/users/5490b98432144f7983e69e2200b35306/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:05.060824 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b106-a2c4-4f9f-b2f6-ae8d2c563e72 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:05.061210 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b106-a2c4-4f9f-b2f6-ae8d2c563e72 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:05.061710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b106-a2c4-4f9f-b2f6-ae8d2c563e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:05.089733 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b328b106-a2c4-4f9f-b2f6-ae8d2c563e72 None None] MFA Rules not processed for user `5490b98432144f7983e69e2200b35306`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:05.090954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b328b106-a2c4-4f9f-b2f6-ae8d2c563e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:05.131724 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:05.156291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1426/2827] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:05.168032 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a75ef-fbb0-46ed-89eb-0c2ee438af4f admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:05.169900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-4c8a75ef-fbb0-46ed-89eb-0c2ee438af4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:05.241983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a75ef-fbb0-46ed-89eb-0c2ee438af4f admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:05.246491 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666b86a-7920-4ff0-a7aa-6313b47a45c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:05.247098 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666b86a-7920-4ff0-a7aa-6313b47a45c9 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:05.247408 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666b86a-7920-4ff0-a7aa-6313b47a45c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:05.247687 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666b86a-7920-4ff0-a7aa-6313b47a45c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:05.256652 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666b86a-7920-4ff0-a7aa-6313b47a45c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:05.258108 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666b86a-7920-4ff0-a7aa-6313b47a45c9 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:05.268262 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1402/2828] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:05.419518 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b106-a2c4-4f9f-b2f6-ae8d2c563e72 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:05.420969 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b328b106-a2c4-4f9f-b2f6-ae8d2c563e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:05.489458 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b106-a2c4-4f9f-b2f6-ae8d2c563e72 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:05.495233 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:05.496018 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:05.496298 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:05.496569 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] PATH_INFO: `/v3/projects/bbfa0f0c4122467ab9df792715bbead8` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:05.497791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfa0f0c4122467ab9df792715bbead8)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:05.499791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:05.607864 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfa0f0c4122467ab9df792715bbead8', 'request_id': 'req-29adc5f2-b655-4a0c-ace9-0b0f456b9209'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.614064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfa0f0c4122467ab9df792715bbead8', 'request_id': 'req-29adc5f2-b655-4a0c-ace9-0b0f456b9209'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.676678 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfa0f0c4122467ab9df792715bbead8', 'request_id': 'req-29adc5f2-b655-4a0c-ace9-0b0f456b9209'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.690565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] The token cache is being invalidate because project bbfa0f0c4122467ab9df792715bbead8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:05.690855 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.691532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-29adc5f2-b655-4a0c-ace9-0b0f456b9209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:05.693033 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1427/2829] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:05 2022] DELETE /identity/v3/projects/bbfa0f0c4122467ab9df792715bbead8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:15.263983 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:15.686345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:16.793038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666b86a-7920-4ff0-a7aa-6313b47a45c9 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:16.804028 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666b86a-7920-4ff0-a7aa-6313b47a45c9 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:16.861698 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:16.862327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:16.862611 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:16.862887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] PATH_INFO: `/v3/users/5490b98432144f7983e69e2200b35306` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:16.864038 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5490b98432144f7983e69e2200b35306)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:16.865959 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:17.021965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5490b98432144f7983e69e2200b35306'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.022545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5490b98432144f7983e69e2200b35306'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.023267 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5490b98432144f7983e69e2200b35306'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.036352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5490b98432144f7983e69e2200b35306'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.092741 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5490b98432144f7983e69e2200b35306'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.107204 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1403/2830] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:16 2022] DELETE /identity/v3/users/5490b98432144f7983e69e2200b35306 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:17.111994 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6081e5c-ee53-4ecd-a391-eafd993602b0 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:17.112488 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6081e5c-ee53-4ecd-a391-eafd993602b0 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:17.112602 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6081e5c-ee53-4ecd-a391-eafd993602b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:17.131776 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f6081e5c-ee53-4ecd-a391-eafd993602b0 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:17.132989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f6081e5c-ee53-4ecd-a391-eafd993602b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:17.194504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1428/2831] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:17.204979 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:17.206532 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:17.265107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d2a86-7168-4c0b-910c-b6dd3418cf95 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:17.268768 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3116ad9-8359-438b-a147-d9f75227fad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:17.269362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3116ad9-8359-438b-a147-d9f75227fad2 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:17.269643 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3116ad9-8359-438b-a147-d9f75227fad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:17.269920 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3116ad9-8359-438b-a147-d9f75227fad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:17.279023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3116ad9-8359-438b-a147-d9f75227fad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:17.280486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3116ad9-8359-438b-a147-d9f75227fad2 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:17.290015 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1404/2832] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:17.677761 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6081e5c-ee53-4ecd-a391-eafd993602b0 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:17.680914 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f6081e5c-ee53-4ecd-a391-eafd993602b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:17.694595 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6081e5c-ee53-4ecd-a391-eafd993602b0 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:17.700032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:17.700791 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:17.701074 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:17.701345 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] PATH_INFO: `/v3/projects/d663fdd08553462f94542fbf56319434` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:17.702498 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d663fdd08553462f94542fbf56319434)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:17.704503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:17.786876 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd663fdd08553462f94542fbf56319434', 'request_id': 'req-103adbe4-d621-46c2-957b-e7ff05aac983'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.793122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd663fdd08553462f94542fbf56319434', 'request_id': 'req-103adbe4-d621-46c2-957b-e7ff05aac983'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.847168 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd663fdd08553462f94542fbf56319434', 'request_id': 'req-103adbe4-d621-46c2-957b-e7ff05aac983'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.858076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] The token cache is being invalidate because project d663fdd08553462f94542fbf56319434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:17.859419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.859419 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:17.860674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1429/2833] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:17 2022] DELETE /identity/v3/projects/d663fdd08553462f94542fbf56319434 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:27.285704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:27.854991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:29.729016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ca88-1e85-46a1-93b1-c35674d2db37 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:29.729515 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ca88-1e85-46a1-93b1-c35674d2db37 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:29.729625 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ca88-1e85-46a1-93b1-c35674d2db37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:29.750688 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-bb24ca88-1e85-46a1-93b1-c35674d2db37 None None] MFA Rules not processed for user `b9cd8839b2694a6592e1289c6bb8e11f`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:29.751971 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-bb24ca88-1e85-46a1-93b1-c35674d2db37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:29.928272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1405/2834] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:06:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:30.237400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:30.238976 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:30.298537 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103adbe4-d621-46c2-957b-e7ff05aac983 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:30.302126 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:30.302728 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:30.303023 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:30.303277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:30.304988 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:30.314928 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:30.316371 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:30.325434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1430/2835] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:39.921531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=25 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:40.320727 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=26 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:42.047260 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24ca88-1e85-46a1-93b1-c35674d2db37 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:42.056980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24ca88-1e85-46a1-93b1-c35674d2db37 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:42.060907 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:42.061861 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:42.062091 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:42.062357 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:42.064263 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:42.075579 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:42.077056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:42.085841 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1406/2836] 10.222.0.17 () {60 vars in 1396 bytes} [Wed Aug 24 08:06:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:49.408293 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:49.409758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:49.485826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e3cf9-54c7-4778-9976-fcad4a149ea9 service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:49.491218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56abd9a-cfbc-4531-aca2-a35bca7f748d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8054e88916456991bf485c19f8b502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:49.491852 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56abd9a-cfbc-4531-aca2-a35bca7f748d service nova] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:49.492137 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56abd9a-cfbc-4531-aca2-a35bca7f748d service nova] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:49.492418 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56abd9a-cfbc-4531-aca2-a35bca7f748d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:49.494181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a56abd9a-cfbc-4531-aca2-a35bca7f748d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:49.507454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56abd9a-cfbc-4531-aca2-a35bca7f748d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:49.508948 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56abd9a-cfbc-4531-aca2-a35bca7f748d service nova] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:49.520165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1431/2837] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:52.081801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=6 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:59.515700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=34 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:56.460376 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:56.461767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:56.530372 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50bcf4-ac09-4012-94f7-204bf66ad562 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:56.535948 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4f7f1-00cb-4d49-b7a3-a036d8f84d0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:56.536547 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4f7f1-00cb-4d49-b7a3-a036d8f84d0e service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:56.536826 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4f7f1-00cb-4d49-b7a3-a036d8f84d0e service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:56.537094 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4f7f1-00cb-4d49-b7a3-a036d8f84d0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:56.538796 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-41e4f7f1-00cb-4d49-b7a3-a036d8f84d0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:56.550612 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4f7f1-00cb-4d49-b7a3-a036d8f84d0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:56.552214 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4f7f1-00cb-4d49-b7a3-a036d8f84d0e service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:56.562224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1407/2838] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:06.557682 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=32 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:28.579989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56abd9a-cfbc-4531-aca2-a35bca7f748d service nova] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:28.589397 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56abd9a-cfbc-4531-aca2-a35bca7f748d service nova] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:28.592982 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:28.593579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:28.593898 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:28.594188 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:28.596434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:28.660108 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:28.661463 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:28.670850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1432/2839] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:31.932749 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4f7f1-00cb-4d49-b7a3-a036d8f84d0e service placement] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:31.943590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4f7f1-00cb-4d49-b7a3-a036d8f84d0e service placement] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:31.948637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cd989-55c4-4d2f-a3d5-35d9ba648595 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:31.949233 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cd989-55c4-4d2f-a3d5-35d9ba648595 service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:31.949510 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cd989-55c4-4d2f-a3d5-35d9ba648595 service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:31.949781 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cd989-55c4-4d2f-a3d5-35d9ba648595 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:31.951731 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-443cd989-55c4-4d2f-a3d5-35d9ba648595 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:31.963912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cd989-55c4-4d2f-a3d5-35d9ba648595 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:31.965551 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cd989-55c4-4d2f-a3d5-35d9ba648595 service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:31.976548 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1408/2840] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:32.050992 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:32.052607 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:32.066377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830a624-66d3-4852-bc12-65e2a5f5b7fe service neutron] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:32.071026 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:32.071696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.076700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.076700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] PATH_INFO: `/v3/users/b9cd8839b2694a6592e1289c6bb8e11f` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.076700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cd8839b2694a6592e1289c6bb8e11f)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:32.076700 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:32.260597 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cd8839b2694a6592e1289c6bb8e11f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.261239 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cd8839b2694a6592e1289c6bb8e11f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.261836 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cd8839b2694a6592e1289c6bb8e11f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.321531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cd8839b2694a6592e1289c6bb8e11f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.334468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-e3fe9273-3093-42dd-94fc-e041886f66e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cd8839b2694a6592e1289c6bb8e11f'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.348772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1433/2841] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:32 2022] DELETE /identity/v3/users/b9cd8839b2694a6592e1289c6bb8e11f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:32.616563 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cd989-55c4-4d2f-a3d5-35d9ba648595 service placement] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:32.629330 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cd989-55c4-4d2f-a3d5-35d9ba648595 service placement] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:32.685501 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:32.686380 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.686661 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.686934 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] PATH_INFO: `/v3/projects/44615ba18b5a434b860517e87caa741d` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.688088 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44615ba18b5a434b860517e87caa741d)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:32.689984 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:32.787275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44615ba18b5a434b860517e87caa741d', 'request_id': 'req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.843366 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44615ba18b5a434b860517e87caa741d', 'request_id': 'req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.849852 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44615ba18b5a434b860517e87caa741d', 'request_id': 'req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.860446 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] The token cache is being invalidate because project 44615ba18b5a434b860517e87caa741d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88251) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:32.860681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.861327 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-34aa9c39-8883-4bf7-a59d-a3f744f2d5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.863087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1409/2842] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:32 2022] DELETE /identity/v3/projects/44615ba18b5a434b860517e87caa741d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:32.868059 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6020b-4a2b-4270-9f3e-7ce357092441 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.868341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6020b-4a2b-4270-9f3e-7ce357092441 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.868611 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6020b-4a2b-4270-9f3e-7ce357092441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.888330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-0fd6020b-4a2b-4270-9f3e-7ce357092441 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:32.889554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-0fd6020b-4a2b-4270-9f3e-7ce357092441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:32.950222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1434/2843] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:32.959495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a204b-91c5-4d8b-b7a4-24333d54dcf7 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.959992 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a204b-91c5-4d8b-b7a4-24333d54dcf7 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.960116 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a204b-91c5-4d8b-b7a4-24333d54dcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.979610 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-9f1a204b-91c5-4d8b-b7a4-24333d54dcf7 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:32.980821 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-9f1a204b-91c5-4d8b-b7a4-24333d54dcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:32.989609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1410/2844] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:32.993883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6020b-4a2b-4270-9f3e-7ce357092441 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.005243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6020b-4a2b-4270-9f3e-7ce357092441 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.009826 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4472c3-027e-487d-ac36-7dedf3b1b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.010457 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4472c3-027e-487d-ac36-7dedf3b1b0fa admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.010881 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4472c3-027e-487d-ac36-7dedf3b1b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.011165 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4472c3-027e-487d-ac36-7dedf3b1b0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.011906 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4472c3-027e-487d-ac36-7dedf3b1b0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:33.013237 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4472c3-027e-487d-ac36-7dedf3b1b0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.014859 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4472c3-027e-487d-ac36-7dedf3b1b0fa admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.016772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:33.028190 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1435/2845] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:33.032929 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a204b-91c5-4d8b-b7a4-24333d54dcf7 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.043101 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a204b-91c5-4d8b-b7a4-24333d54dcf7 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.047912 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584898f-deb6-4808-853e-741bff34f1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.048587 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584898f-deb6-4808-853e-741bff34f1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.048952 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584898f-deb6-4808-853e-741bff34f1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.049369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584898f-deb6-4808-853e-741bff34f1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.051107 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584898f-deb6-4808-853e-741bff34f1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.053114 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584898f-deb6-4808-853e-741bff34f1f5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.195416 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1411/2846] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:33.199433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4472c3-027e-487d-ac36-7dedf3b1b0fa admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.210218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4472c3-027e-487d-ac36-7dedf3b1b0fa admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.266523 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239d4c-f3c3-4a1e-ac15-30f1bd850468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.267122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239d4c-f3c3-4a1e-ac15-30f1bd850468 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.267462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239d4c-f3c3-4a1e-ac15-30f1bd850468 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.267744 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239d4c-f3c3-4a1e-ac15-30f1bd850468 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.268424 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1239d4c-f3c3-4a1e-ac15-30f1bd850468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.270328 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1239d4c-f3c3-4a1e-ac15-30f1bd850468 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.347276 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1436/2847] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/users => generated 303 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:33.351418 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584898f-deb6-4808-853e-741bff34f1f5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.361881 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584898f-deb6-4808-853e-741bff34f1f5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.367182 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6986a-2bde-495b-8147-bbc8fb942c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.367875 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6986a-2bde-495b-8147-bbc8fb942c17 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.368151 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6986a-2bde-495b-8147-bbc8fb942c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.368419 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6986a-2bde-495b-8147-bbc8fb942c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.369055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6986a-2bde-495b-8147-bbc8fb942c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.370637 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6986a-2bde-495b-8147-bbc8fb942c17 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.380639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1412/2848] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:33.384779 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239d4c-f3c3-4a1e-ac15-30f1bd850468 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.394702 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239d4c-f3c3-4a1e-ac15-30f1bd850468 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.399310 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fd396-3677-4bff-8074-cdd3b0d85202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.399913 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fd396-3677-4bff-8074-cdd3b0d85202 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.400192 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fd396-3677-4bff-8074-cdd3b0d85202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.400468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fd396-3677-4bff-8074-cdd3b0d85202 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.401097 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fd396-3677-4bff-8074-cdd3b0d85202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.402703 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fd396-3677-4bff-8074-cdd3b0d85202 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.413654 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1437/2849] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:33.417589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6986a-2bde-495b-8147-bbc8fb942c17 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.428470 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6986a-2bde-495b-8147-bbc8fb942c17 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.433006 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b3d60-cae2-4f04-a8de-02028d44123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.433642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b3d60-cae2-4f04-a8de-02028d44123b admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.433922 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b3d60-cae2-4f04-a8de-02028d44123b admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.434198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b3d60-cae2-4f04-a8de-02028d44123b admin admin] PATH_INFO: `/v3/projects/19fa1303241c41859e882aa0c998f866/users/eac723e606434f2da7b676b7671bfdf2/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.449255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b3d60-cae2-4f04-a8de-02028d44123b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fa1303241c41859e882aa0c998f866, user_id=eac723e606434f2da7b676b7671bfdf2, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.451851 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b3d60-cae2-4f04-a8de-02028d44123b admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.546802 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1413/2850] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:33 2022] PUT /identity/v3/projects/19fa1303241c41859e882aa0c998f866/users/eac723e606434f2da7b676b7671bfdf2/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:33.558236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67356e26-3376-4e0b-878a-1f5a1d48e815 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.558525 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67356e26-3376-4e0b-878a-1f5a1d48e815 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.558805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67356e26-3376-4e0b-878a-1f5a1d48e815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.589136 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-67356e26-3376-4e0b-878a-1f5a1d48e815 None None] MFA Rules not processed for user `eac723e606434f2da7b676b7671bfdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:33.590357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-67356e26-3376-4e0b-878a-1f5a1d48e815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.662850 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1438/2851] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:33.667443 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b3d60-cae2-4f04-a8de-02028d44123b admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.681908 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:33.731186 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b3d60-cae2-4f04-a8de-02028d44123b admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.735767 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a2154-9f72-46de-8736-af6a661a233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.736368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a2154-9f72-46de-8736-af6a661a233e admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.736673 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a2154-9f72-46de-8736-af6a661a233e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.737527 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a2154-9f72-46de-8736-af6a661a233e admin admin] PATH_INFO: `/v3/projects` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.738312 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a2154-9f72-46de-8736-af6a661a233e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.740272 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a2154-9f72-46de-8736-af6a661a233e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.839142 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1414/2852] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/projects => generated 405 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:33.843403 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67356e26-3376-4e0b-878a-1f5a1d48e815 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.855501 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67356e26-3376-4e0b-878a-1f5a1d48e815 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.912482 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c683e-6050-4d08-8256-5e47fb5834c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.913086 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c683e-6050-4d08-8256-5e47fb5834c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.913370 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c683e-6050-4d08-8256-5e47fb5834c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.913648 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c683e-6050-4d08-8256-5e47fb5834c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.914285 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c683e-6050-4d08-8256-5e47fb5834c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.916250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c683e-6050-4d08-8256-5e47fb5834c6 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.925183 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:33.995939 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1439/2853] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:34.000103 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a2154-9f72-46de-8736-af6a661a233e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.010572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a2154-9f72-46de-8736-af6a661a233e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.015194 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ee91c-818a-44f6-b6b5-ad08d6bfaccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.015827 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee91c-818a-44f6-b6b5-ad08d6bfaccb admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.016110 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee91c-818a-44f6-b6b5-ad08d6bfaccb admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.016386 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ee91c-818a-44f6-b6b5-ad08d6bfaccb admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.017055 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ee91c-818a-44f6-b6b5-ad08d6bfaccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.019274 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ee91c-818a-44f6-b6b5-ad08d6bfaccb admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.029322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1415/2854] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:34.033410 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c683e-6050-4d08-8256-5e47fb5834c6 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.044575 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c683e-6050-4d08-8256-5e47fb5834c6 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.049220 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb46e-a490-45fb-99df-6d26af3e6825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.049899 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb46e-a490-45fb-99df-6d26af3e6825 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.050157 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb46e-a490-45fb-99df-6d26af3e6825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.050433 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb46e-a490-45fb-99df-6d26af3e6825 admin admin] PATH_INFO: `/v3/projects/ee64404b916849febcf22eabaf485b8b/users/385c968865dd47e6a1969a4c1992b7e0/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.065129 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb46e-a490-45fb-99df-6d26af3e6825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee64404b916849febcf22eabaf485b8b, user_id=385c968865dd47e6a1969a4c1992b7e0, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.067873 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb46e-a490-45fb-99df-6d26af3e6825 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.168341 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1440/2855] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:34 2022] PUT /identity/v3/projects/ee64404b916849febcf22eabaf485b8b/users/385c968865dd47e6a1969a4c1992b7e0/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:34.172401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ee91c-818a-44f6-b6b5-ad08d6bfaccb admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.182450 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ee91c-818a-44f6-b6b5-ad08d6bfaccb admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.238900 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecec767-8403-4978-b308-d3bf8b4bdada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.239533 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecec767-8403-4978-b308-d3bf8b4bdada admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.239819 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecec767-8403-4978-b308-d3bf8b4bdada admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.240095 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecec767-8403-4978-b308-d3bf8b4bdada admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.240730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecec767-8403-4978-b308-d3bf8b4bdada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.242319 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecec767-8403-4978-b308-d3bf8b4bdada admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.251844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1416/2856] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:34.257447 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb46e-a490-45fb-99df-6d26af3e6825 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.267730 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb46e-a490-45fb-99df-6d26af3e6825 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.273346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5563e06-f804-476f-8128-059273308407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.273983 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5563e06-f804-476f-8128-059273308407 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.274269 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5563e06-f804-476f-8128-059273308407 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.274538 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5563e06-f804-476f-8128-059273308407 admin admin] PATH_INFO: `/v3/projects/ee64404b916849febcf22eabaf485b8b/users/385c968865dd47e6a1969a4c1992b7e0/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.276470 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5563e06-f804-476f-8128-059273308407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee64404b916849febcf22eabaf485b8b, user_id=385c968865dd47e6a1969a4c1992b7e0, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.279093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5563e06-f804-476f-8128-059273308407 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.289076 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1441/2857] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:34 2022] PUT /identity/v3/projects/ee64404b916849febcf22eabaf485b8b/users/385c968865dd47e6a1969a4c1992b7e0/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:34.300518 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02244aea-032a-4ef7-a75d-ed44786a5173 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.300806 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02244aea-032a-4ef7-a75d-ed44786a5173 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.301084 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02244aea-032a-4ef7-a75d-ed44786a5173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.329480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-02244aea-032a-4ef7-a75d-ed44786a5173 None None] MFA Rules not processed for user `385c968865dd47e6a1969a4c1992b7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:34.331236 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-02244aea-032a-4ef7-a75d-ed44786a5173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:34.400641 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1417/2858] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:34.411800 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5563e06-f804-476f-8128-059273308407 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.413472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e5563e06-f804-476f-8128-059273308407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:34.470484 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5563e06-f804-476f-8128-059273308407 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.474612 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8f8b3-2c63-4340-8310-161170ebe92f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.475198 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8f8b3-2c63-4340-8310-161170ebe92f service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.475503 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8f8b3-2c63-4340-8310-161170ebe92f service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.475772 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8f8b3-2c63-4340-8310-161170ebe92f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.484587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8f8b3-2c63-4340-8310-161170ebe92f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.486004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8f8b3-2c63-4340-8310-161170ebe92f service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.495801 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1442/2859] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:34 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:34.732362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02244aea-032a-4ef7-a75d-ed44786a5173 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.741954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:34.793662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02244aea-032a-4ef7-a75d-ed44786a5173 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.798113 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.798735 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.799020 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.799300 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] PATH_INFO: `/v3/users/eac723e606434f2da7b676b7671bfdf2` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.801293 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac723e606434f2da7b676b7671bfdf2)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.803545 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.992878 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac723e606434f2da7b676b7671bfdf2'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:34.993576 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac723e606434f2da7b676b7671bfdf2'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:34.994193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac723e606434f2da7b676b7671bfdf2'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:35.006575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac723e606434f2da7b676b7671bfdf2'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:35.058666 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac723e606434f2da7b676b7671bfdf2'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:35.072253 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1418/2860] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:34 2022] DELETE /identity/v3/users/eac723e606434f2da7b676b7671bfdf2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:35.076771 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983aece-b34c-4144-85e5-d9d1338a7ae9 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.077062 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983aece-b34c-4144-85e5-d9d1338a7ae9 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.077338 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983aece-b34c-4144-85e5-d9d1338a7ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.098327 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d983aece-b34c-4144-85e5-d9d1338a7ae9 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:35.099563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d983aece-b34c-4144-85e5-d9d1338a7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:35.157955 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1443/2861] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:35.168089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:35.169473 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:35.227301 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e4325-805d-49dd-a10a-1780de57eff9 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:35.230842 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f36d-3691-4d27-9ebb-1b1e55adfea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:35.231468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f36d-3691-4d27-9ebb-1b1e55adfea1 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.231744 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f36d-3691-4d27-9ebb-1b1e55adfea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.232019 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f36d-3691-4d27-9ebb-1b1e55adfea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.241534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f36d-3691-4d27-9ebb-1b1e55adfea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:35.242954 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f36d-3691-4d27-9ebb-1b1e55adfea1 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:35.252120 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1419/2862] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:35.628212 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983aece-b34c-4144-85e5-d9d1338a7ae9 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:35.629725 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d983aece-b34c-4144-85e5-d9d1338a7ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:35.642497 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983aece-b34c-4144-85e5-d9d1338a7ae9 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:35.647679 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:35.648326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.648608 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.648884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] PATH_INFO: `/v3/projects/19fa1303241c41859e882aa0c998f866` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.650736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fa1303241c41859e882aa0c998f866)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:35.652110 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:35.752357 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fa1303241c41859e882aa0c998f866', 'request_id': 'req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:35.754271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:35.758588 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fa1303241c41859e882aa0c998f866', 'request_id': 'req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:35.849161 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fa1303241c41859e882aa0c998f866', 'request_id': 'req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:35.859999 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] The token cache is being invalidate because project 19fa1303241c41859e882aa0c998f866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:35.860278 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:35.860902 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:35.863048 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1444/2863] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:35 2022] DELETE /identity/v3/projects/19fa1303241c41859e882aa0c998f866 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:35.867311 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f36d-3691-4d27-9ebb-1b1e55adfea1 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:35.876995 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f36d-3691-4d27-9ebb-1b1e55adfea1 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:35.906065 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:35.936405 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:35.937068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.937347 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.937620 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] PATH_INFO: `/v3/users/385c968865dd47e6a1969a4c1992b7e0` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.938763 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=385c968865dd47e6a1969a4c1992b7e0)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:35.941023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:36.144045 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385c968865dd47e6a1969a4c1992b7e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.144844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385c968865dd47e6a1969a4c1992b7e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.145480 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385c968865dd47e6a1969a4c1992b7e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.160016 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385c968865dd47e6a1969a4c1992b7e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.238437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-60a2390d-56c1-4331-b183-3b6522460696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385c968865dd47e6a1969a4c1992b7e0'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.251428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1420/2864] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:35 2022] DELETE /identity/v3/users/385c968865dd47e6a1969a4c1992b7e0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:36.617002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:36.621628 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:36.632252 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f4d05-9a81-4b88-85ca-f588f8dcd485 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:36.693209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:36.693967 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:36.694259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:36.694566 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] PATH_INFO: `/v3/projects/ee64404b916849febcf22eabaf485b8b` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:36.695778 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee64404b916849febcf22eabaf485b8b)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:36.697691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:36.792219 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee64404b916849febcf22eabaf485b8b', 'request_id': 'req-cd2abe8a-3306-4253-81d0-9366daee52cd'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.798439 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee64404b916849febcf22eabaf485b8b', 'request_id': 'req-cd2abe8a-3306-4253-81d0-9366daee52cd'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.887710 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee64404b916849febcf22eabaf485b8b', 'request_id': 'req-cd2abe8a-3306-4253-81d0-9366daee52cd'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.900807 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] The token cache is being invalidate because project ee64404b916849febcf22eabaf485b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:36.901014 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.901669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-cd2abe8a-3306-4253-81d0-9366daee52cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:36.903164 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1445/2865] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:36 2022] DELETE /identity/v3/projects/ee64404b916849febcf22eabaf485b8b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:36.910269 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5310feb-11c9-45dd-8fae-5d4372ff52da None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:36.910559 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5310feb-11c9-45dd-8fae-5d4372ff52da None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:36.910838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5310feb-11c9-45dd-8fae-5d4372ff52da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:36.933018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-e5310feb-11c9-45dd-8fae-5d4372ff52da None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:36.934373 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-e5310feb-11c9-45dd-8fae-5d4372ff52da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:37.000126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1421/2866] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:37.010102 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832907e-670f-40e0-a1d6-cf5600c6b298 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.010388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832907e-670f-40e0-a1d6-cf5600c6b298 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.010691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832907e-670f-40e0-a1d6-cf5600c6b298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.031044 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-a832907e-670f-40e0-a1d6-cf5600c6b298 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:37.032294 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-a832907e-670f-40e0-a1d6-cf5600c6b298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:37.040339 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1446/2867] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:37.044897 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5310feb-11c9-45dd-8fae-5d4372ff52da None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.055924 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5310feb-11c9-45dd-8fae-5d4372ff52da None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.061068 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28522-b628-4b61-a2f6-434630309bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.061724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28522-b628-4b61-a2f6-434630309bca admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.062009 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28522-b628-4b61-a2f6-434630309bca admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.062275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee28522-b628-4b61-a2f6-434630309bca admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.062914 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28522-b628-4b61-a2f6-434630309bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:37.063210 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28522-b628-4b61-a2f6-434630309bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.064825 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee28522-b628-4b61-a2f6-434630309bca admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.079578 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1422/2868] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:37.084139 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832907e-670f-40e0-a1d6-cf5600c6b298 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.093655 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832907e-670f-40e0-a1d6-cf5600c6b298 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.099138 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fb6a8-b873-451f-a7ce-72138bdd8030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.099788 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fb6a8-b873-451f-a7ce-72138bdd8030 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.100071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fb6a8-b873-451f-a7ce-72138bdd8030 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.100330 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fb6a8-b873-451f-a7ce-72138bdd8030 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.100966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fb6a8-b873-451f-a7ce-72138bdd8030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.102867 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fb6a8-b873-451f-a7ce-72138bdd8030 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.194263 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1447/2869] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:37.198067 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28522-b628-4b61-a2f6-434630309bca admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.208939 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee28522-b628-4b61-a2f6-434630309bca admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.243945 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:37.267434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbbef4-766b-4b30-859e-055b2a8ee18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.268286 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbbef4-766b-4b30-859e-055b2a8ee18e admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.268576 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbbef4-766b-4b30-859e-055b2a8ee18e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.268873 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbbef4-766b-4b30-859e-055b2a8ee18e admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.269951 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbbef4-766b-4b30-859e-055b2a8ee18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.272719 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbbef4-766b-4b30-859e-055b2a8ee18e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.386216 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1423/2870] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:37.390645 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fb6a8-b873-451f-a7ce-72138bdd8030 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.401417 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fb6a8-b873-451f-a7ce-72138bdd8030 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.406072 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5b973-9e7f-4cf7-8d5a-205f4f552494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.407843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5b973-9e7f-4cf7-8d5a-205f4f552494 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.408131 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5b973-9e7f-4cf7-8d5a-205f4f552494 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.408406 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5b973-9e7f-4cf7-8d5a-205f4f552494 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.410040 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5b973-9e7f-4cf7-8d5a-205f4f552494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.411691 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5b973-9e7f-4cf7-8d5a-205f4f552494 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.422480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1448/2871] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:37.427420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbbef4-766b-4b30-859e-055b2a8ee18e admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.439243 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbbef4-766b-4b30-859e-055b2a8ee18e admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.445303 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f90da6-37f7-4ca3-b5a6-c7a7e0e32766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.446076 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f90da6-37f7-4ca3-b5a6-c7a7e0e32766 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.446354 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f90da6-37f7-4ca3-b5a6-c7a7e0e32766 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.446705 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f90da6-37f7-4ca3-b5a6-c7a7e0e32766 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.447622 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f90da6-37f7-4ca3-b5a6-c7a7e0e32766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.449730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f90da6-37f7-4ca3-b5a6-c7a7e0e32766 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.460314 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1424/2872] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:37.464554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5b973-9e7f-4cf7-8d5a-205f4f552494 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.475047 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5b973-9e7f-4cf7-8d5a-205f4f552494 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.479547 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc5df8-774c-4620-8ebe-1784efbc6063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.480184 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc5df8-774c-4620-8ebe-1784efbc6063 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.480469 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc5df8-774c-4620-8ebe-1784efbc6063 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.480737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc5df8-774c-4620-8ebe-1784efbc6063 admin admin] PATH_INFO: `/v3/projects/bc597414e11f4edca291d3726797fad6/users/559b0e3a964d4df9b60b4e2cf9890d3b/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.495736 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc5df8-774c-4620-8ebe-1784efbc6063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc597414e11f4edca291d3726797fad6, user_id=559b0e3a964d4df9b60b4e2cf9890d3b, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.498363 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc5df8-774c-4620-8ebe-1784efbc6063 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.592829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1449/2873] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:37 2022] PUT /identity/v3/projects/bc597414e11f4edca291d3726797fad6/users/559b0e3a964d4df9b60b4e2cf9890d3b/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:37.604353 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1a9aa-c937-45b0-88fd-beb296590627 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.604650 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1a9aa-c937-45b0-88fd-beb296590627 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.605013 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1a9aa-c937-45b0-88fd-beb296590627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.642410 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-abd1a9aa-c937-45b0-88fd-beb296590627 None None] MFA Rules not processed for user `559b0e3a964d4df9b60b4e2cf9890d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:37.645531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-abd1a9aa-c937-45b0-88fd-beb296590627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:37.713850 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1425/2874] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:37.718307 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc5df8-774c-4620-8ebe-1784efbc6063 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.728671 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:37.792947 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc5df8-774c-4620-8ebe-1784efbc6063 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.797637 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6917177-9c65-4ceb-a1cc-1bf50af9dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.798241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917177-9c65-4ceb-a1cc-1bf50af9dbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.798524 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917177-9c65-4ceb-a1cc-1bf50af9dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.798798 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917177-9c65-4ceb-a1cc-1bf50af9dbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.799468 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6917177-9c65-4ceb-a1cc-1bf50af9dbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.801398 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6917177-9c65-4ceb-a1cc-1bf50af9dbe4 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.897819 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1450/2875] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:37.901245 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1a9aa-c937-45b0-88fd-beb296590627 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.912284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1a9aa-c937-45b0-88fd-beb296590627 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.968898 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1ef6-8daa-4a8e-908c-8b4f18818d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.969427 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1ef6-8daa-4a8e-908c-8b4f18818d09 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.969710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1ef6-8daa-4a8e-908c-8b4f18818d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.969982 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db1ef6-8daa-4a8e-908c-8b4f18818d09 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.970594 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db1ef6-8daa-4a8e-908c-8b4f18818d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.972543 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db1ef6-8daa-4a8e-908c-8b4f18818d09 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.060931 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1426/2876] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:38.065565 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6917177-9c65-4ceb-a1cc-1bf50af9dbe4 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.076236 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6917177-9c65-4ceb-a1cc-1bf50af9dbe4 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.083100 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cb689-25fe-431f-9bd4-f3ee056170ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.083737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cb689-25fe-431f-9bd4-f3ee056170ba admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.084013 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cb689-25fe-431f-9bd4-f3ee056170ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.084283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cb689-25fe-431f-9bd4-f3ee056170ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.084919 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cb689-25fe-431f-9bd4-f3ee056170ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.086511 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cb689-25fe-431f-9bd4-f3ee056170ba admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.097690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1451/2877] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:38.101617 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1ef6-8daa-4a8e-908c-8b4f18818d09 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.111836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db1ef6-8daa-4a8e-908c-8b4f18818d09 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.116440 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a0fc7-e4a6-41c4-90f6-644dfcb61821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.117033 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a0fc7-e4a6-41c4-90f6-644dfcb61821 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.117333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a0fc7-e4a6-41c4-90f6-644dfcb61821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.117586 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a0fc7-e4a6-41c4-90f6-644dfcb61821 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.118221 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a0fc7-e4a6-41c4-90f6-644dfcb61821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.119848 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a0fc7-e4a6-41c4-90f6-644dfcb61821 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.130404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1427/2878] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:38.134377 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cb689-25fe-431f-9bd4-f3ee056170ba admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.144817 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cb689-25fe-431f-9bd4-f3ee056170ba admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.149486 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecebbd-2b28-4790-bb45-cc82dd1da467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.150127 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecebbd-2b28-4790-bb45-cc82dd1da467 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.150409 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecebbd-2b28-4790-bb45-cc82dd1da467 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.150684 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecebbd-2b28-4790-bb45-cc82dd1da467 admin admin] PATH_INFO: `/v3/projects/2616e178a3384787a9abeeb66a67b5bc/users/9116c81acf3d4750bc86c5c3fc361067/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.165259 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecebbd-2b28-4790-bb45-cc82dd1da467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2616e178a3384787a9abeeb66a67b5bc, user_id=9116c81acf3d4750bc86c5c3fc361067, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.167946 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecebbd-2b28-4790-bb45-cc82dd1da467 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.232315 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1452/2879] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:38 2022] PUT /identity/v3/projects/2616e178a3384787a9abeeb66a67b5bc/users/9116c81acf3d4750bc86c5c3fc361067/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:38.244258 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc327fc-a951-4161-8e60-4a58f8a0be67 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.244742 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc327fc-a951-4161-8e60-4a58f8a0be67 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.244862 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc327fc-a951-4161-8e60-4a58f8a0be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.272255 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-5bc327fc-a951-4161-8e60-4a58f8a0be67 None None] MFA Rules not processed for user `9116c81acf3d4750bc86c5c3fc361067`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:38.273468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-5bc327fc-a951-4161-8e60-4a58f8a0be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:38.284915 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:38.337198 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1428/2880] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:38.341811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecebbd-2b28-4790-bb45-cc82dd1da467 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.402162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecebbd-2b28-4790-bb45-cc82dd1da467 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.406815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26946f-33ae-4a24-a628-4464cd23b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.407437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26946f-33ae-4a24-a628-4464cd23b7ba admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.407719 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26946f-33ae-4a24-a628-4464cd23b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.407991 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26946f-33ae-4a24-a628-4464cd23b7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.408658 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26946f-33ae-4a24-a628-4464cd23b7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.410743 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26946f-33ae-4a24-a628-4464cd23b7ba admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.484257 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1453/2881] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:38 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:38.488859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc327fc-a951-4161-8e60-4a58f8a0be67 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.499649 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc327fc-a951-4161-8e60-4a58f8a0be67 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.555669 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788181a-e867-4ea1-994d-ddd0e4f998f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.556275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788181a-e867-4ea1-994d-ddd0e4f998f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.556558 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788181a-e867-4ea1-994d-ddd0e4f998f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.556828 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788181a-e867-4ea1-994d-ddd0e4f998f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.557434 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788181a-e867-4ea1-994d-ddd0e4f998f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.559342 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788181a-e867-4ea1-994d-ddd0e4f998f6 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.631885 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1429/2882] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:38 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:38.635929 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26946f-33ae-4a24-a628-4464cd23b7ba admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.646326 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26946f-33ae-4a24-a628-4464cd23b7ba admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.651015 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52956de0-c25c-4b29-abea-204b5ed82d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.651632 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52956de0-c25c-4b29-abea-204b5ed82d30 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.651924 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52956de0-c25c-4b29-abea-204b5ed82d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.652208 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52956de0-c25c-4b29-abea-204b5ed82d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.652846 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52956de0-c25c-4b29-abea-204b5ed82d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.654437 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52956de0-c25c-4b29-abea-204b5ed82d30 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.666485 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1454/2883] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:38.670609 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788181a-e867-4ea1-994d-ddd0e4f998f6 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.681492 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788181a-e867-4ea1-994d-ddd0e4f998f6 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.686774 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeaa08-fd66-4cc9-8fd1-680adfea62a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.687466 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeaa08-fd66-4cc9-8fd1-680adfea62a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.687748 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeaa08-fd66-4cc9-8fd1-680adfea62a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.688023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eeaa08-fd66-4cc9-8fd1-680adfea62a4 admin admin] PATH_INFO: `/v3/projects/cb933aec35fb4ddabf04f34f1507d3a2/users/5c2cac375a674071aeb77a81da39a8dd/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.702352 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeaa08-fd66-4cc9-8fd1-680adfea62a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb933aec35fb4ddabf04f34f1507d3a2, user_id=5c2cac375a674071aeb77a81da39a8dd, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.705218 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eeaa08-fd66-4cc9-8fd1-680adfea62a4 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.790423 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1430/2884] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:38 2022] PUT /identity/v3/projects/cb933aec35fb4ddabf04f34f1507d3a2/users/5c2cac375a674071aeb77a81da39a8dd/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:38.794452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52956de0-c25c-4b29-abea-204b5ed82d30 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.805028 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52956de0-c25c-4b29-abea-204b5ed82d30 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.833930 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:38.861548 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e3735-ac89-4d5a-a5ee-b62feab145fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.862843 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e3735-ac89-4d5a-a5ee-b62feab145fc admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.863124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e3735-ac89-4d5a-a5ee-b62feab145fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.863598 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e3735-ac89-4d5a-a5ee-b62feab145fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.864378 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e3735-ac89-4d5a-a5ee-b62feab145fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.866364 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e3735-ac89-4d5a-a5ee-b62feab145fc admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.875989 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1455/2885] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:38.880139 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeaa08-fd66-4cc9-8fd1-680adfea62a4 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.890479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eeaa08-fd66-4cc9-8fd1-680adfea62a4 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.895165 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d3f7c-4d2b-4eff-96cc-a245b66dd674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.895844 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d3f7c-4d2b-4eff-96cc-a245b66dd674 admin admin] REQUEST_METHOD: `PUT` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.896127 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d3f7c-4d2b-4eff-96cc-a245b66dd674 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.896403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d3f7c-4d2b-4eff-96cc-a245b66dd674 admin admin] PATH_INFO: `/v3/projects/cb933aec35fb4ddabf04f34f1507d3a2/users/5c2cac375a674071aeb77a81da39a8dd/roles/c7ce63b9a09b4c318578d01192d287fc` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.898318 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d3f7c-4d2b-4eff-96cc-a245b66dd674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb933aec35fb4ddabf04f34f1507d3a2, user_id=5c2cac375a674071aeb77a81da39a8dd, role_id=c7ce63b9a09b4c318578d01192d287fc)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.900998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d3f7c-4d2b-4eff-96cc-a245b66dd674 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.912474 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1431/2886] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:38 2022] PUT /identity/v3/projects/cb933aec35fb4ddabf04f34f1507d3a2/users/5c2cac375a674071aeb77a81da39a8dd/roles/c7ce63b9a09b4c318578d01192d287fc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:38.922550 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204192c-1620-463f-8557-56129a5531ba None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.922858 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204192c-1620-463f-8557-56129a5531ba None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.923128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204192c-1620-463f-8557-56129a5531ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.950883 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e204192c-1620-463f-8557-56129a5531ba None None] MFA Rules not processed for user `5c2cac375a674071aeb77a81da39a8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:38.952111 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e204192c-1620-463f-8557-56129a5531ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.020972 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1456/2887] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:39.031923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d3f7c-4d2b-4eff-96cc-a245b66dd674 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:39.034164 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-807d3f7c-4d2b-4eff-96cc-a245b66dd674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.091765 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d3f7c-4d2b-4eff-96cc-a245b66dd674 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:39.095499 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb45ba6-7d5e-4d97-b68f-55efa9fd7b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:39.096131 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb45ba6-7d5e-4d97-b68f-55efa9fd7b82 service cinder] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.096413 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb45ba6-7d5e-4d97-b68f-55efa9fd7b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.096868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb45ba6-7d5e-4d97-b68f-55efa9fd7b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.106530 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb45ba6-7d5e-4d97-b68f-55efa9fd7b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:39.108007 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb45ba6-7d5e-4d97-b68f-55efa9fd7b82 service cinder] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:39.118121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1432/2888] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:39.264180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204192c-1620-463f-8557-56129a5531ba None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:39.265596 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e204192c-1620-463f-8557-56129a5531ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.278178 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204192c-1620-463f-8557-56129a5531ba None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:39.281805 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49e81c-fb18-426f-b3e5-8ce62ea83c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:39.282400 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49e81c-fb18-426f-b3e5-8ce62ea83c78 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.282682 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49e81c-fb18-426f-b3e5-8ce62ea83c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.282957 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49e81c-fb18-426f-b3e5-8ce62ea83c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.341656 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49e81c-fb18-426f-b3e5-8ce62ea83c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:39.343095 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49e81c-fb18-426f-b3e5-8ce62ea83c78 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:39.353411 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1457/2889] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:43.359431 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb45ba6-7d5e-4d97-b68f-55efa9fd7b82 service cinder] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.369193 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:43.420362 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb45ba6-7d5e-4d97-b68f-55efa9fd7b82 service cinder] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.424836 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.425447 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.425723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.425990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] PATH_INFO: `/v3/users/559b0e3a964d4df9b60b4e2cf9890d3b` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.427087 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559b0e3a964d4df9b60b4e2cf9890d3b)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.429025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.646251 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559b0e3a964d4df9b60b4e2cf9890d3b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.646921 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559b0e3a964d4df9b60b4e2cf9890d3b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.647554 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559b0e3a964d4df9b60b4e2cf9890d3b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.659923 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559b0e3a964d4df9b60b4e2cf9890d3b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.712464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559b0e3a964d4df9b60b4e2cf9890d3b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.725225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1433/2890] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:43 2022] DELETE /identity/v3/users/559b0e3a964d4df9b60b4e2cf9890d3b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:43.729735 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d14d9-dc47-43a9-8b80-9fe601f84386 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.730235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d14d9-dc47-43a9-8b80-9fe601f84386 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.730354 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d14d9-dc47-43a9-8b80-9fe601f84386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.750241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-f60d14d9-dc47-43a9-8b80-9fe601f84386 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:43.751388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f60d14d9-dc47-43a9-8b80-9fe601f84386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.796820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=100 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:43.816117 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1458/2891] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:43.826453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.827919 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.887944 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9a3ba-4f57-4fec-b6e4-fa7837803950 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.891556 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbefb8e-8ceb-433b-b097-fdce9875c490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.892161 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbefb8e-8ceb-433b-b097-fdce9875c490 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.892442 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbefb8e-8ceb-433b-b097-fdce9875c490 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.892724 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbefb8e-8ceb-433b-b097-fdce9875c490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.901677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbefb8e-8ceb-433b-b097-fdce9875c490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.903126 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbefb8e-8ceb-433b-b097-fdce9875c490 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.913121 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1434/2892] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:44.296669 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d14d9-dc47-43a9-8b80-9fe601f84386 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:44.298128 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-f60d14d9-dc47-43a9-8b80-9fe601f84386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.310912 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d14d9-dc47-43a9-8b80-9fe601f84386 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:44.315832 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:44.316472 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.316758 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.317032 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] PATH_INFO: `/v3/projects/bc597414e11f4edca291d3726797fad6` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.318167 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc597414e11f4edca291d3726797fad6)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.320109 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.433180 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc597414e11f4edca291d3726797fad6', 'request_id': 'req-ab4da869-6d46-479d-9cd7-91706d57b949'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.441235 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc597414e11f4edca291d3726797fad6', 'request_id': 'req-ab4da869-6d46-479d-9cd7-91706d57b949'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.529140 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc597414e11f4edca291d3726797fad6', 'request_id': 'req-ab4da869-6d46-479d-9cd7-91706d57b949'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.540487 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] The token cache is being invalidate because project bc597414e11f4edca291d3726797fad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:44.540718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.541346 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.542829 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1459/2893] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:44 2022] DELETE /identity/v3/projects/bc597414e11f4edca291d3726797fad6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:44.546858 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbefb8e-8ceb-433b-b097-fdce9875c490 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:44.556535 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbefb8e-8ceb-433b-b097-fdce9875c490 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:44.585368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:44.613224 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:44.613947 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.614439 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.614928 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] PATH_INFO: `/v3/users/9116c81acf3d4750bc86c5c3fc361067` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.616369 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9116c81acf3d4750bc86c5c3fc361067)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.618361 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.816596 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9116c81acf3d4750bc86c5c3fc361067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.817333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9116c81acf3d4750bc86c5c3fc361067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.817980 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9116c81acf3d4750bc86c5c3fc361067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.830658 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9116c81acf3d4750bc86c5c3fc361067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.911704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9116c81acf3d4750bc86c5c3fc361067'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.924716 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1435/2894] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:44 2022] DELETE /identity/v3/users/9116c81acf3d4750bc86c5c3fc361067 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:45.350642 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.352132 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.366760 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4da869-6d46-479d-9cd7-91706d57b949 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.425065 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.425716 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.426002 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.426271 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] PATH_INFO: `/v3/projects/2616e178a3384787a9abeeb66a67b5bc` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.427399 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2616e178a3384787a9abeeb66a67b5bc)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.429288 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.536309 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2616e178a3384787a9abeeb66a67b5bc', 'request_id': 'req-9630b6b0-66a1-49fa-8bb7-440a3a36715b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.542504 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2616e178a3384787a9abeeb66a67b5bc', 'request_id': 'req-9630b6b0-66a1-49fa-8bb7-440a3a36715b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.609197 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2616e178a3384787a9abeeb66a67b5bc', 'request_id': 'req-9630b6b0-66a1-49fa-8bb7-440a3a36715b'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.619975 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] The token cache is being invalidate because project 2616e178a3384787a9abeeb66a67b5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:45.620262 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.620884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.622361 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1460/2895] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:45 2022] DELETE /identity/v3/projects/2616e178a3384787a9abeeb66a67b5bc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:45.626522 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.628683 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.641392 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b14262-077e-47c0-b620-af11a8e03765 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.698589 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.699219 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.699555 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.699870 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] PATH_INFO: `/v3/users/5c2cac375a674071aeb77a81da39a8dd` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.700946 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2cac375a674071aeb77a81da39a8dd)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.702868 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.867089 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2cac375a674071aeb77a81da39a8dd'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.867676 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2cac375a674071aeb77a81da39a8dd'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.868284 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2cac375a674071aeb77a81da39a8dd'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.872712 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:45.881569 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2cac375a674071aeb77a81da39a8dd'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.949642 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-e2037e02-eb5d-4087-bb99-a528fa16cc9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2cac375a674071aeb77a81da39a8dd'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.962736 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1436/2896] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:45 2022] DELETE /identity/v3/users/5c2cac375a674071aeb77a81da39a8dd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:46.409579 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.411124 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.423386 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:46.428304 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630b6b0-66a1-49fa-8bb7-440a3a36715b admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.488532 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.489585 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.489922 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.490200 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] PATH_INFO: `/v3/projects/cb933aec35fb4ddabf04f34f1507d3a2` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.491384 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb933aec35fb4ddabf04f34f1507d3a2)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.493320 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.592277 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb933aec35fb4ddabf04f34f1507d3a2', 'request_id': 'req-41ee4d60-7f89-4904-a30a-ac5d42345895'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:46.601176 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb933aec35fb4ddabf04f34f1507d3a2', 'request_id': 'req-41ee4d60-7f89-4904-a30a-ac5d42345895'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:46.672080 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb933aec35fb4ddabf04f34f1507d3a2', 'request_id': 'req-41ee4d60-7f89-4904-a30a-ac5d42345895'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:46.682714 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] The token cache is being invalidate because project cb933aec35fb4ddabf04f34f1507d3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:46.684718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:46.684718 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-41ee4d60-7f89-4904-a30a-ac5d42345895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:46.685317 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1461/2897] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:46 2022] DELETE /identity/v3/projects/cb933aec35fb4ddabf04f34f1507d3a2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:46.691730 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8918b-5a33-4201-a9f2-33c0b8d43982 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.692201 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8918b-5a33-4201-a9f2-33c0b8d43982 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.692321 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8918b-5a33-4201-a9f2-33c0b8d43982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.712063 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-d9b8918b-5a33-4201-a9f2-33c0b8d43982 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:46.713235 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-d9b8918b-5a33-4201-a9f2-33c0b8d43982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.772441 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1437/2898] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:46.780738 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d95e-64c3-409c-995f-904c67961e3f None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.781017 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d95e-64c3-409c-995f-904c67961e3f None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.781285 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d95e-64c3-409c-995f-904c67961e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.801067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-dcf8d95e-64c3-409c-995f-904c67961e3f None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:46.802245 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-dcf8d95e-64c3-409c-995f-904c67961e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.809962 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1462/2899] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:46.814508 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8918b-5a33-4201-a9f2-33c0b8d43982 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.824681 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8918b-5a33-4201-a9f2-33c0b8d43982 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.829209 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203cafd-1961-4f7b-b89e-4293c3b7b6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.829801 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203cafd-1961-4f7b-b89e-4293c3b7b6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.830583 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203cafd-1961-4f7b-b89e-4293c3b7b6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.830859 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203cafd-1961-4f7b-b89e-4293c3b7b6b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.831531 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203cafd-1961-4f7b-b89e-4293c3b7b6b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:46.831838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203cafd-1961-4f7b-b89e-4293c3b7b6b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.833438 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203cafd-1961-4f7b-b89e-4293c3b7b6b9 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.844805 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1438/2900] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:46.850004 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8d95e-64c3-409c-995f-904c67961e3f None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.859492 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8d95e-64c3-409c-995f-904c67961e3f None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.864267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e01965-0173-4382-a279-24363ee68d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.864861 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e01965-0173-4382-a279-24363ee68d8e admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.865151 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e01965-0173-4382-a279-24363ee68d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.865434 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e01965-0173-4382-a279-24363ee68d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.866064 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e01965-0173-4382-a279-24363ee68d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.868071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e01965-0173-4382-a279-24363ee68d8e admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.963578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1463/2901] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:46.967722 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203cafd-1961-4f7b-b89e-4293c3b7b6b9 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.978023 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203cafd-1961-4f7b-b89e-4293c3b7b6b9 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.033572 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30bcc0-a315-46b8-a0b0-d693fb035a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.034172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bcc0-a315-46b8-a0b0-d693fb035a61 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.034453 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bcc0-a315-46b8-a0b0-d693fb035a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.034725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bcc0-a315-46b8-a0b0-d693fb035a61 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.035368 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30bcc0-a315-46b8-a0b0-d693fb035a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.037275 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30bcc0-a315-46b8-a0b0-d693fb035a61 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.112203 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1439/2902] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:47.116359 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e01965-0173-4382-a279-24363ee68d8e admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:47.126769 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e01965-0173-4382-a279-24363ee68d8e admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.132112 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab5016-c38d-4ee3-b36b-7c116f01e79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.132701 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab5016-c38d-4ee3-b36b-7c116f01e79c admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.132984 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab5016-c38d-4ee3-b36b-7c116f01e79c admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.133261 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab5016-c38d-4ee3-b36b-7c116f01e79c admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.133932 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab5016-c38d-4ee3-b36b-7c116f01e79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.135554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab5016-c38d-4ee3-b36b-7c116f01e79c admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.146578 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1464/2903] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:47.150534 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30bcc0-a315-46b8-a0b0-d693fb035a61 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:47.160976 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30bcc0-a315-46b8-a0b0-d693fb035a61 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.165640 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6284a-dafa-43c4-811b-82a874342104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.166238 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6284a-dafa-43c4-811b-82a874342104 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.166521 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6284a-dafa-43c4-811b-82a874342104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.166794 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6284a-dafa-43c4-811b-82a874342104 admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.167493 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6284a-dafa-43c4-811b-82a874342104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.169092 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6284a-dafa-43c4-811b-82a874342104 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.179723 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1440/2904] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:47.183707 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab5016-c38d-4ee3-b36b-7c116f01e79c admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:47.194481 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab5016-c38d-4ee3-b36b-7c116f01e79c admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.199019 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019dd82-c13e-467a-b94d-555e9cbc754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.199694 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019dd82-c13e-467a-b94d-555e9cbc754d admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.199980 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019dd82-c13e-467a-b94d-555e9cbc754d admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.200249 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019dd82-c13e-467a-b94d-555e9cbc754d admin admin] PATH_INFO: `/v3/projects/d8240b9207684752adc399bf65de9932/users/f1ca83604bd04d3483072e5218a2cb6b/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.215077 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019dd82-c13e-467a-b94d-555e9cbc754d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8240b9207684752adc399bf65de9932, user_id=f1ca83604bd04d3483072e5218a2cb6b, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.217665 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019dd82-c13e-467a-b94d-555e9cbc754d admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.301942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1465/2905] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:47 2022] PUT /identity/v3/projects/d8240b9207684752adc399bf65de9932/users/f1ca83604bd04d3483072e5218a2cb6b/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:47.369277 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10885-b585-4e08-98e7-85812f1362ae None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.369564 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10885-b585-4e08-98e7-85812f1362ae None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.369838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10885-b585-4e08-98e7-85812f1362ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.397648 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-c5a10885-b585-4e08-98e7-85812f1362ae None None] MFA Rules not processed for user `f1ca83604bd04d3483072e5218a2cb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:47.398832 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-c5a10885-b585-4e08-98e7-85812f1362ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:47.421830 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:47.462691 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1441/2906] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:08:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:47.474809 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019dd82-c13e-467a-b94d-555e9cbc754d admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:47.476568 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b019dd82-c13e-467a-b94d-555e9cbc754d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:47.512499 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:47.557222 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019dd82-c13e-467a-b94d-555e9cbc754d admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.561187 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ff854-637d-4fa3-9a70-0e8ffc6a3e32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f436ac7cc2f04919bb0ec1ad9fca5622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.561783 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ff854-637d-4fa3-9a70-0e8ffc6a3e32 service glance] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.562071 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ff854-637d-4fa3-9a70-0e8ffc6a3e32 service glance] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.562353 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ff854-637d-4fa3-9a70-0e8ffc6a3e32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.571695 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ff854-637d-4fa3-9a70-0e8ffc6a3e32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.573122 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ff854-637d-4fa3-9a70-0e8ffc6a3e32 service glance] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.582462 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1466/2907] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:57.515655 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=16 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:57.803426 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=21 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:06.847965 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a10885-b585-4e08-98e7-85812f1362ae None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.909793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a10885-b585-4e08-98e7-85812f1362ae None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.914710 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.915458 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.915822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.916115 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] PATH_INFO: `/v3/users/f1ca83604bd04d3483072e5218a2cb6b` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.917295 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ca83604bd04d3483072e5218a2cb6b)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.919346 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.077200 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ca83604bd04d3483072e5218a2cb6b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.077788 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ca83604bd04d3483072e5218a2cb6b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.078404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ca83604bd04d3483072e5218a2cb6b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.090967 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ca83604bd04d3483072e5218a2cb6b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.160495 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ca83604bd04d3483072e5218a2cb6b'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.173353 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1442/2908] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:06 2022] DELETE /identity/v3/users/f1ca83604bd04d3483072e5218a2cb6b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:07.178388 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1807-7ac6-46fb-9d1d-662e8c8ea4e4 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.178857 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1807-7ac6-46fb-9d1d-662e8c8ea4e4 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.178966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1807-7ac6-46fb-9d1d-662e8c8ea4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.198813 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-d42c1807-7ac6-46fb-9d1d-662e8c8ea4e4 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:07.200067 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d42c1807-7ac6-46fb-9d1d-662e8c8ea4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.258674 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1467/2909] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:07.268367 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.269829 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.329159 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17c429-e513-4924-bf4c-4fc923e59a0a admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.333018 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd417b3-3448-498a-9e6c-b91422a07cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.333634 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd417b3-3448-498a-9e6c-b91422a07cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.333916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd417b3-3448-498a-9e6c-b91422a07cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.334192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd417b3-3448-498a-9e6c-b91422a07cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.343437 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd417b3-3448-498a-9e6c-b91422a07cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.344887 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd417b3-3448-498a-9e6c-b91422a07cf7 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.354457 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1443/2910] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:07.764291 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1807-7ac6-46fb-9d1d-662e8c8ea4e4 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.766202 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-d42c1807-7ac6-46fb-9d1d-662e8c8ea4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.779917 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1807-7ac6-46fb-9d1d-662e8c8ea4e4 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.784614 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.785243 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.786360 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.786990 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] PATH_INFO: `/v3/projects/d8240b9207684752adc399bf65de9932` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.788283 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8240b9207684752adc399bf65de9932)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.790500 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.895563 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8240b9207684752adc399bf65de9932', 'request_id': 'req-85acffe7-6fa5-4f49-a438-57aba06b83c2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.901709 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8240b9207684752adc399bf65de9932', 'request_id': 'req-85acffe7-6fa5-4f49-a438-57aba06b83c2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.968708 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8240b9207684752adc399bf65de9932', 'request_id': 'req-85acffe7-6fa5-4f49-a438-57aba06b83c2'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.980253 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] The token cache is being invalidate because project d8240b9207684752adc399bf65de9932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:07.980591 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.981218 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-85acffe7-6fa5-4f49-a438-57aba06b83c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.982690 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1468/2911] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:07 2022] DELETE /identity/v3/projects/d8240b9207684752adc399bf65de9932 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:07.987662 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc6fc4-f8f0-4b24-bbc1-5939e0a7dd84 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.988192 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc6fc4-f8f0-4b24-bbc1-5939e0a7dd84 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.988305 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc6fc4-f8f0-4b24-bbc1-5939e0a7dd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.008261 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-16cc6fc4-f8f0-4b24-bbc1-5939e0a7dd84 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:08.009448 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-16cc6fc4-f8f0-4b24-bbc1-5939e0a7dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:08.026343 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:08.068482 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1444/2912] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:08.076314 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343b26-2c1b-4f66-b161-9423ef1039bb None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.076605 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343b26-2c1b-4f66-b161-9423ef1039bb None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.076884 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2343b26-2c1b-4f66-b161-9423ef1039bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.097705 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-b2343b26-2c1b-4f66-b161-9423ef1039bb None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:08.098907 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-b2343b26-2c1b-4f66-b161-9423ef1039bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:08.106803 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1469/2913] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:08.111237 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc6fc4-f8f0-4b24-bbc1-5939e0a7dd84 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.122111 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc6fc4-f8f0-4b24-bbc1-5939e0a7dd84 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.126613 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaccf68-02a1-43a3-babc-2d407deaca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.127677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaccf68-02a1-43a3-babc-2d407deaca56 admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.127677 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaccf68-02a1-43a3-babc-2d407deaca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.127916 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaccf68-02a1-43a3-babc-2d407deaca56 admin admin] PATH_INFO: `/v3/domains` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.128575 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaccf68-02a1-43a3-babc-2d407deaca56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88251) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:08.128877 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaccf68-02a1-43a3-babc-2d407deaca56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.130464 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaccf68-02a1-43a3-babc-2d407deaca56 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.141847 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1445/2914] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:08.147423 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343b26-2c1b-4f66-b161-9423ef1039bb None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.156681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2343b26-2c1b-4f66-b161-9423ef1039bb None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.161986 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cff3e-4786-4e25-901b-940acf78dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.162587 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cff3e-4786-4e25-901b-940acf78dc63 admin admin] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.162878 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cff3e-4786-4e25-901b-940acf78dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.163162 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cff3e-4786-4e25-901b-940acf78dc63 admin admin] PATH_INFO: `/v3/projects` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.163835 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cff3e-4786-4e25-901b-940acf78dc63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.165737 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cff3e-4786-4e25-901b-940acf78dc63 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.247420 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1470/2915] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:08 2022] POST /identity/v3/projects => generated 397 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:08.251590 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaccf68-02a1-43a3-babc-2d407deaca56 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.262468 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaccf68-02a1-43a3-babc-2d407deaca56 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.317822 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc91fb-4a4d-45c1-91af-752825aa3708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.318420 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc91fb-4a4d-45c1-91af-752825aa3708 admin admin] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.318701 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc91fb-4a4d-45c1-91af-752825aa3708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.318990 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc91fb-4a4d-45c1-91af-752825aa3708 admin admin] PATH_INFO: `/v3/users` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.319639 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc91fb-4a4d-45c1-91af-752825aa3708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.321544 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc91fb-4a4d-45c1-91af-752825aa3708 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.420302 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1446/2916] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:08 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:08.424952 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cff3e-4786-4e25-901b-940acf78dc63 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.435696 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cff3e-4786-4e25-901b-940acf78dc63 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.441373 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36395bb7-3933-4fcb-a19e-2c15ea724cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.441974 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36395bb7-3933-4fcb-a19e-2c15ea724cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.442251 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36395bb7-3933-4fcb-a19e-2c15ea724cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.442521 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36395bb7-3933-4fcb-a19e-2c15ea724cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.443155 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36395bb7-3933-4fcb-a19e-2c15ea724cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.444811 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36395bb7-3933-4fcb-a19e-2c15ea724cf5 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.454966 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1471/2917] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:08.459793 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc91fb-4a4d-45c1-91af-752825aa3708 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.469797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc91fb-4a4d-45c1-91af-752825aa3708 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.474570 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f69bde-274d-4566-b309-9d70adb4e48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.475163 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f69bde-274d-4566-b309-9d70adb4e48e admin admin] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.475486 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f69bde-274d-4566-b309-9d70adb4e48e admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.475766 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f69bde-274d-4566-b309-9d70adb4e48e admin admin] PATH_INFO: `/v3/roles` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.476403 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f69bde-274d-4566-b309-9d70adb4e48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.477986 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f69bde-274d-4566-b309-9d70adb4e48e admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.488585 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1447/2918] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:08.492646 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36395bb7-3933-4fcb-a19e-2c15ea724cf5 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.502681 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36395bb7-3933-4fcb-a19e-2c15ea724cf5 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.507882 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c5dbb-e448-49b7-b143-a5964ecb8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.508531 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c5dbb-e448-49b7-b143-a5964ecb8a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.508815 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c5dbb-e448-49b7-b143-a5964ecb8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.509093 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c5dbb-e448-49b7-b143-a5964ecb8a88 admin admin] PATH_INFO: `/v3/projects/2f79a9f4940044a9a4b8e8b7310cfd1e/users/fa471c0453fd4f0696673229017d9b6d/roles/2b1ba082ef764b35bc85187a263a9016` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.524042 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c5dbb-e448-49b7-b143-a5964ecb8a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f79a9f4940044a9a4b8e8b7310cfd1e, user_id=fa471c0453fd4f0696673229017d9b6d, role_id=2b1ba082ef764b35bc85187a263a9016)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.526692 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c5dbb-e448-49b7-b143-a5964ecb8a88 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.637241 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1472/2919] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:08 2022] PUT /identity/v3/projects/2f79a9f4940044a9a4b8e8b7310cfd1e/users/fa471c0453fd4f0696673229017d9b6d/roles/2b1ba082ef764b35bc85187a263a9016 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:08.648079 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390a9d0-3c68-4fac-ae1a-7d2f43134b05 None None] REQUEST_METHOD: `POST` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.652356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390a9d0-3c68-4fac-ae1a-7d2f43134b05 None None] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.652356 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390a9d0-3c68-4fac-ae1a-7d2f43134b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.676797 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.auth.core [None req-2390a9d0-3c68-4fac-ae1a-7d2f43134b05 None None] MFA Rules not processed for user `fa471c0453fd4f0696673229017d9b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88251) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:08.677933 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-2390a9d0-3c68-4fac-ae1a-7d2f43134b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:08.741537 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1448/2920] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:09:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:08.753574 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c5dbb-e448-49b7-b143-a5964ecb8a88 admin admin] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.755250 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-3b7c5dbb-e448-49b7-b143-a5964ecb8a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:08.777290 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:08.813942 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c5dbb-e448-49b7-b143-a5964ecb8a88 admin admin] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.817888 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b17f39-4b64-4fb7-b5a9-e7f1284a3d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3de64d734a04f9e9ab0d85e5c985e6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.820599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17f39-4b64-4fb7-b5a9-e7f1284a3d24 service cinder] REQUEST_METHOD: `GET` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.820599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17f39-4b64-4fb7-b5a9-e7f1284a3d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.820599 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b17f39-4b64-4fb7-b5a9-e7f1284a3d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.827452 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b17f39-4b64-4fb7-b5a9-e7f1284a3d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.828875 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b17f39-4b64-4fb7-b5a9-e7f1284a3d24 service cinder] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.838493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1473/2921] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:14.818903 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390a9d0-3c68-4fac-ae1a-7d2f43134b05 None None] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:14.837654 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:14.880401 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390a9d0-3c68-4fac-ae1a-7d2f43134b05 None None] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:14.885025 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:14.885665 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:14.885949 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:14.886225 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] PATH_INFO: `/v3/users/fa471c0453fd4f0696673229017d9b6d` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:14.887404 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa471c0453fd4f0696673229017d9b6d)` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:14.892754 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:15.096760 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa471c0453fd4f0696673229017d9b6d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.097536 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa471c0453fd4f0696673229017d9b6d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.098153 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa471c0453fd4f0696673229017d9b6d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.110430 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa471c0453fd4f0696673229017d9b6d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.191333 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.notifications [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa471c0453fd4f0696673229017d9b6d'} {{(pid=88251) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.204145 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1449/2922] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:14 2022] DELETE /identity/v3/users/fa471c0453fd4f0696673229017d9b6d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:15.209493 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ec6c0-62bb-4358-9460-c782f3ed85b2 None None] REQUEST_METHOD: `POST` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.209997 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ec6c0-62bb-4358-9460-c782f3ed85b2 None None] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.210177 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ec6c0-62bb-4358-9460-c782f3ed85b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.229389 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.auth.core [None req-e83ec6c0-62bb-4358-9460-c782f3ed85b2 None None] MFA Rules not processed for user `46428667f2c84b109fb9821da86b0938`. Rule list: `[]` (Enabled: `True`). {{(pid=88252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:15.230601 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e83ec6c0-62bb-4358-9460-c782f3ed85b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.289325 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1474/2923] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 24 08:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:15.299229 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:15.300758 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.358704 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8597ea-cf60-447b-9423-f2bbbac178b5 admin admin] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:15.362839 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c4389-da9e-4aea-8cf9-42830ecbf835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4403ef0835a4d658f8eb50fac0780eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:15.363472 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c4389-da9e-4aea-8cf9-42830ecbf835 service neutron] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.363755 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c4389-da9e-4aea-8cf9-42830ecbf835 service neutron] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.364026 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c4389-da9e-4aea-8cf9-42830ecbf835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.372989 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c4389-da9e-4aea-8cf9-42830ecbf835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:15.374422 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c4389-da9e-4aea-8cf9-42830ecbf835 service neutron] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:15.384672 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1450/2924] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:15.804267 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ec6c0-62bb-4358-9460-c782f3ed85b2 None None] Authenticating user token {{(pid=88252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:15.805734 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.fernet_utils [None req-e83ec6c0-62bb-4358-9460-c782f3ed85b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.819554 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ec6c0-62bb-4358-9460-c782f3ed85b2 None None] Validating token access rules against request {{(pid=88252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:15.824181 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46428667f2c84b109fb9821da86b0938', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa975bb77094d52bcdbb2bd261327d8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:15.824820 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.825106 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.825385 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] PATH_INFO: `/v3/projects/2f79a9f4940044a9a4b8e8b7310cfd1e` {{(pid=88252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.826520 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f79a9f4940044a9a4b8e8b7310cfd1e)` {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:15.828480 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] RBAC: Authorization granted {{(pid=88252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:15.955454 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f79a9f4940044a9a4b8e8b7310cfd1e', 'request_id': 'req-60880d3e-47bd-4288-a564-c4d75a88e091'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.962814 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f79a9f4940044a9a4b8e8b7310cfd1e', 'request_id': 'req-60880d3e-47bd-4288-a564-c4d75a88e091'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:16.048619 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f79a9f4940044a9a4b8e8b7310cfd1e', 'request_id': 'req-60880d3e-47bd-4288-a564-c4d75a88e091'} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:16.060046 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] The token cache is being invalidate because project 2f79a9f4940044a9a4b8e8b7310cfd1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:16.060586 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:16.061209 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG keystone.notifications [None req-60880d3e-47bd-4288-a564-c4d75a88e091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:16.062699 dv-cinder-854275-1-smb devstack@keystone.service[88252]: [pid: 88252|app: 0|req: 1475/2925] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:15 2022] DELETE /identity/v3/projects/2f79a9f4940044a9a4b8e8b7310cfd1e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:25.380571 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:26.056954 dv-cinder-854275-1-smb devstack@keystone.service[88252]: DEBUG dbcounter [-] [88252] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:02.353428 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c4389-da9e-4aea-8cf9-42830ecbf835 service neutron] Authenticating user token {{(pid=88251) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:02.354838 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-673c4389-da9e-4aea-8cf9-42830ecbf835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:02.498304 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c4389-da9e-4aea-8cf9-42830ecbf835 service neutron] Validating token access rules against request {{(pid=88251) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:02.557322 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725a0ae-8678-4b35-a331-de15a00203a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36bd5aef3c034c41be036c4cc9eed376', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5326f878c814478b71a7e9badf70d02', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88251) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:02.558172 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725a0ae-8678-4b35-a331-de15a00203a7 service placement] REQUEST_METHOD: `GET` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:02.558454 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725a0ae-8678-4b35-a331-de15a00203a7 service placement] SCRIPT_NAME: `/identity` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:02.558725 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725a0ae-8678-4b35-a331-de15a00203a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88251) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:02.560479 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.fernet_utils [None req-7725a0ae-8678-4b35-a331-de15a00203a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88251) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:02.572483 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725a0ae-8678-4b35-a331-de15a00203a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:02.574056 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725a0ae-8678-4b35-a331-de15a00203a7 service placement] RBAC: Authorization granted {{(pid=88251) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:02.583998 dv-cinder-854275-1-smb devstack@keystone.service[88251]: [pid: 88251|app: 0|req: 1451/2926] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:12.579956 dv-cinder-854275-1-smb devstack@keystone.service[88251]: DEBUG dbcounter [-] [88251] Writing DB stats keystone:SELECT=89 {{(pid=88251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}